Ozias Primitive Baptist Church was constituted July 14, 1832, with Elders Wilson Conner and John Martial as the Presbytery. Its members were John McDonald, Randall McDonald, Elijah Hunter, Penelope Hunter, Catherine McCall, Mary McDonald, and Elizabeth McDonald. The Rev. Randall McDonald was pastor, and Redding Hunter was clerk. On March 11, 1854, the church agreed to change its name to Bethlehem Church. The Rev. Hardy McGlawn and the Rev. W.F. Willis served as the first pastors after Bethlehem Church was constituted.