At the site of Elm Hall Plantation, donated by Dr. E. E. Kittredge, a congregation was organized and a church was constructed in 1853. The architect was Frank Willis. The church was consecrated by the Rt. Rev. Leonidas K. Polk in 1854, and W.W. Pugh served as warden from 1853 to 1905.