Nolte was born February 8, 1941, in Omaha, Nebraska. His father, Franklin Arthur Nolte (1904–1978), was a farmer's son who ran away from home, nearly dropped out of high school and was a three-time letter winner in football at Iowa State University (1929–1931). His mother, Helen (née King; 1914–2000), was a department store buyer and then became an expert Antique Dealer co-owning a prestigious and successful Antique Shop despite having no formal education in this area. His ancestry includes German, English, Scots-Irish, Scottish and Swiss-German. Nolte's maternal grandfather, Matthew Leander King, invented the hollow-tile silo and was prominent in early aviation. His maternal grandmother ran the student union at Iowa State University. He has an older sister, Nancy, who was an executive for the Red Cross.