Caledonia Memorial United Methodist Church was founded by William Garberson in 1830, was dedicated in 1909, and was entered in the National Register of Historic Places in 1979.