Pilgrims' Rest Cemetery was established in 1854 when Pilgrims' Rest Baptist Church was founded across the road on September 17 of that year. The cemetery remained prominent in Alco even after the original congregation moved and Alco Methodist Church took possession of the property in 1889. Thirteen victims of an 1883 yellow fever epidemic are buried here, as is Edmund Troupe Brewton, who came to this area in 1861 as a railroad agent and is believed to be the namesake for the City of Brewton.