Bethany Primitive Baptist Church began as an arm of Union Church in 1841 and was formally constituted in May, 1847. In the cemetery adjoining the church, on the high bluff of Arabia Bay, are buried many of the pioneers of this section, including William Smith, a Revolutionary soldier.