A Quaker meeting was established on Goose Creek in 1757, and a meeting house was built. Fear of Indians caused most of the Quakers to move elsewhere, though some later returned. Attempts to re-establish the Goose Creek Meeting were unsuccessful. Before 1824, a church was established here and was known as Difficult Creek Baptist Church. The present church, Quaker Baptist, was built in 1898 near the site of the old building.