Taylor was born on 16 June 1862 in Kirton in Lindsey, Lincolnshire, England, the son of Edward Taylor and his wife, Anne Turner. The Taylors emigrated to New Zealand in 1873, arriving at Lyttelton on the Cardigan Castle on 15 November. They settled in Addington. Taylor briefly continued his education at Christchurch West School but left in 1874 for employment.