In 1878, St. James' Episcopal Church proposed building a mission church in Hamilton Parish east of Warrenton. Although the branch church was first planned for New Baltimore, this site at Mates Hill on Baldwin's Ridge was judged more suitable. The land, then part of Rockspring Farm, was donated by Joseph W. Blackwell, and the parish rector, the Rev. George W. Nelson, appointed a Board of Trustees to carry out the project. As money was raised, construction continued until completion in 1883. Land beside the church was set aside for a graveyard with family plots, following local custom. Named Christ's Chapel, the branch church served people unable to travel to the main church in Warrenton. In 1904, St. James Church had 161 members, including 20 members of the chapel at Baldwin's Ridge, and weekly Sunday afternoon services were held there. The chapel remained in use until it closed during World War II because of shortages of fuel and other supplies. In 1949, after permission was obtained from the Bishop of Virginia, the chapel was deconsecrated and its furnishings were removed to St. James in Warrenton. The building was dismantled in the 1950's, but the graveyard continues undisturbed.