The first Presbyterian Church in Grayville was organized in 1850 under the leadership of Mrs. Thomasann Gray. In 1868, its members built a small wooden church on this corner of the cemetery as a gift from a member of the Gray family. It was replaced by a large brick structure in 1915. The congregation disbanded in 2005, and the land was returned to the Gray family.