St. Paul's Episcopal Church was built in 1818 on the model of St. Paul's, New York. Its first rector was Rev. Amos G. Baldwin, and it was dedicated by Bishop Hobart.