Before the Civil War, First Presbyterian Church, founded in 1839 and dedicated in 1851, required prospective members to swear that they had never owned slaves, and anti-slavery sermons were regularly delivered from its pulpit. Items found in the crawl space under the sanctuary, some dating from the Underground Railroad era, are on exhibit at the Racine Heritage Museum.