In 1984, he had a son, Andrew Sarofim, with Linda Hicks, a former employee at his company. In 1986, they had another son, Phillip Sarofim; and in 1989, she had another child with a different Father whom Sarofim adopted. In 1990, he divorced his first wife who received a $250 million divorce settlement. In 1990, he married Hicks; in 1996, they divorced with Hicks receiving a $12 million settlement. Hicks later died while climbing Mount Kilimanjaro.