Residents in the area now known as Hazen began assembling in various homes as early as 1729 to form the First Church of what was then Greenwich Township in Hunterdon County. In 1734 they erected a log church in the area variously known as Upper Greenwich, Greenwich Upon Delaware, and Oxford. The area later became part of Morris County on March 15, 1738, Sussex County on June 8, 1753, Oxford Township in Sussex County in 1754, Warren County on November 20, 1824, and White Township in 1913. The church grew and prospered, with early services conducted by the Rev. James Campbell, the Rev. David Brainerd, and the Rev. Daniel Lawrence, and in 1749 the congregation affiliated with the Presbyter of New Brunswick. A new frame church replaced the log building in 1806, and the present brick structure was built on the same site in 1856, making it the oldest Presbyterian church on the same site in Warren County. It became the mother church for the Belvidere Presbyterian Church and the Second Presbyterian Church of Oxford. Recognizing 1744 as its formal organizational year, its members, from the founders through the present, were honored in 1994 for their spiritual and temporal contributions to the culture, history, and quality of life of Warren County, Oxford Township, and White Township.