Milford Baptist Church stood on this site for more than 120 years from about 1880 until February 2002. These rocks served as pillars for that building just as Milford Baptist Church has been the foundation of this community since 1834. The two-story structure on this site replaced the original log church, which burned in 1873.