Born in Cleveland, Ohio, in 1928, Lovell was the only child of his mother Blanche, who was of Czech descent, and his father, a coal furnace salesman, who died in a car accident in 1933. For about two years, he and his mother resided with a relative in Terre Haute, Indiana. His mother then moved them to Milwaukee, Wisconsin, where he graduated from Juneau High School. He became an Eagle Scout.