A congregational chapel was first built on this site in 1813 and replaced in 1847 by a Greek Revival church with a spire said to be reminiscent of the London spires designed by Christopher Wren. It became one of America's most photographed churches and appeared on the cover of Elvis Presley's 1967 album "How Great Thou Art." Nearby, the Dexter Grist Mill is a restoration of the original mill built in 1640 by Thomas Dexter, where early settlers from miles around came to the center of town to have their grain ground into flour. The mill sits on the dam that creates a large millpond, and at one time a tag factory and then a tea shop stood next to it.