St. Paul's Episcopal Church was erected in 1816 and was the first church edifice in the village of Oxford.