A stone foundation and graveyard mark the site of Prince William County's first Presbyterian Church, established in 1848 on land donated by the Kline family. Buried in the cemetery are Presbyterian founders, a Methodist minister and his family, and Confederate soldier Stephen E. Wilks, who died of typhoid in August 1861. Many members fled during the Civil War, causing the church to close, and a later fire destroyed the structure, though Mrs. Mary Kline saved the communion service and some pews before it was lost. After the Civil War the congregation reconvened and rebuilt, but membership remained difficult to sustain. The church closed in 1890, its organ was to be moved to Greenwood Presbyterian Church, and White Hall Presbyterian Church continued services there from 1900 to 1910 before it was finally dissolved and the property sold. The empty building then fell into disrepair and collapsed in the late 1940s.