The Reformed Presbyterian Church of Vernon was built in 1854 and was organized by Scottish settlers in October, 1848 with Rev. James Milligan at the home of James Wright Sr. The last regular services were held in 1920. It was the only Covenanter church ever formed in Wisconsin.