Gause Baptist Church was founded in 1877 by a group of settlers, with W.T.N. Beasley of Rockdale serving as pastor. Services were discontinued in 1889, though Sunday School remained active, and in 1893 the congregation was reorganized and moved services to the Methodist Church Building. John Whitfield Stephen, who lived from 1860 to 1927, served as the second pastor, and the church had 38 members. Four years later, the congregation built its own building on land donated by J.R. Fraim, who lived from 1832 to 1907, and its steeple was topped with a bell still in use today. In the early half of the twentieth century, the church held successful revivals, and new converts were sometimes baptized nearby in the Little River. In 1950, the original frame building was replaced with another frame building that included central heating and cooling, and a new parsonage was also built. In later years, brick exterior walls were erected. The church's center has always been the people who serve, and to date 48 pastors have served it. Among its dedicated members were Emmagene Ferguson Goode Bland, who was baptized there in 1921 and taught a women's Sunday School class for 44 years, and C.W. Moore, who oversaw cemetery funds and raised his son Joe in the church. Joe Moore later played left field for the New York Giants in the 1930s and 40s during a 12-year career that included three pennants and a world championship, and after returning he became a deacon and took over cemetery fund management from his father. For more than a century, Gause Baptist Church has been a faithful pillar of its community.