Adams was born in Oakfield, Maine, on March 6, 1937, to Nina P. (Armstrong) and Joe Claron Adams. He grew up in Gorham, Maine, alongside his brother Jim. Their father was MIA during WWII.