Len Goodman had an idea about when he'd die ... he told PEOPLE, referring to his wife, Sue, son, James, and his two grandchildren, Alice and Dan. "I will miss the California sunshine, working ...