First Church was organized in 1821 and built in 1823 by Puritan settlers. It was rebuilt in 1854, and its original bell is now in use.