First Presbyterian Church, the oldest church building in Gallatin in continuous existence, was organized on October 25, 1828. The building was erected in 1836-37 and is an example of early Greek Revival architecture. During the Civil War, the sanctuary was used as a hospital for Federal troops.