Gilyard was born into a military family in Moses Lake, Washington, in 1955, the son of Clarence Gilyard Sr., a U.S. Air Force officer. His family was originally from New Orleans, Louisiana but Gilyard grew up on Air Force bases in Hawaii, Texas, and Florida. Raised primarily as a Lutheran, he became Catholic in the 1990s.