Built in 1834 by the Congregational Society, Stone Church was dedicated with a sermon by Rev. O. Bartholomew, and Rev. John Cross served as an early pastor.