In 1954 Walcott married Fay Moston, a secretary, but the marriage ended in divorce in 1959. They had a son, the St Lucian Painter Peter Walcott. Walcott married a second time to Margaret Maillard in 1962, who worked as an almoner in a hospital, and together they had two daughters, Elizabeth, and Anna; they divorced in 1976. In 1976, Walcott married for a third time, to Actress Norline Metivier (divorced in 1993). He was survived by his longtime companion, Sigrid Nama, a former art gallery owner.