Pleasant Hill Cemetery, founded in 1853, grew up around the Brunswick Cumberland Presbyterian Church, which has since moved. During the Confederate War, the church building was used as a hospital, and 17 unknown Confederate soldiers who died there are buried in a nearby plot. Also buried there are many of the region's pioneers.