Organized on February 20, 1811, by Rev. Samuel Fuller, the church was built in 1815, and Fuller served as rector for thirty-one years.