First Presbyterian began with the village’s first church worship in a red school house in 1813, followed by a white wooden church in 1830, and the present brick church in 1865, designed by architect Horatio N. White.