The Presbyterian, or Old Stone, Church in Esperance, New York, was organized on May 2, 1823. Its edifice was dedicated on July 4, 1824. Sheldon Jackson was received as a member on October 2, 1853. The church was remodeled and rededicated on January 14, 1897.