Stone Church was built in 1831 after two previous buildings burned within three years as First Presbyterian Church in Lowville, New York.