Walsh was born in Ogdensburg, New York, the son of Agnes Katharine (née Sullivan) and Harry Maurice Walsh, Sr., a customs agent. He is of Irish descent. He was raised in rural Swanton, Vermont, and attended college at Clarkson University. He graduated in 1958 (B.A., Business Administration). In 1998, the Clarkson Alumni Association presented him with the Golden Knight Award.