Ruston's First Presbyterian Church was organized in 1884 by the Rev. Mr. J. A. McLees, pastor for the Vienna, Alabama and Vernon churches. Its Gothic Revival style building was erected in 1923 by Mr. C. C. Davis during the pastorate of the Rev. Dr. S. E. McFadden.