St. John the Baptist began as an Anglican church 2.5 miles southwest of here on what is now Gravel Hill Road. It was consecrated in 1728 but deteriorated in hard times. Regular Episcopal worship ended in 1799. When services resumed, this building was consecrated in 1877. The 1929 altar window was designed and constructed in England. A 1936 remodel added the narthex and covered the exterior with clinker brick. The parish hall was added in 1941. The church is a contributing building in the Milton Historic District, which is listed in the National Register of Historic Places.