Founded May 29, 1829, First Baptist Church is the oldest church in the hamlet of Newfane, and its cobblestone building was erected in 1843.