Organized in 1815 as the Church and Society of Gravel Hill, this church began as a branch of Midway Church, with the Rev. Robert Quarterman as its first pastor. Its first edifice was built in 1836 on land donated by Simon Fraser. The present building was completed in 1850 honoring William Fleming, and the church was separated from Midway in 1865. In 1866 it was admitted to the Georgia Presbytery with the Rev. D.B. Buttolph as pastor; W.E.W. Quarterman, Thomas Cassels, Ezra Stacy, and James Laing as elders; and S. A. Fraser and L. M. Cassels as deacons. Ezra Stacy was the first Sunday School Superintendent, and the bell and silver communion service came from Midway Church.