The original log church was built one mile northwest in 1790. In 1846 it became the Cove and Paris Presbyterian Churches. Rev. Elisha McCurdy, a pioneer preacher, missionary, and reformer, was pastor from 1799 to 1824 and at Florence until 1835.