St. Alban's Episcopal Church was first built in 1858 along the Jackson-Vicksburg Road, now known as The Warriors Trail, and consecrated in 1859. During the Civil War, it became a haven for civilians fleeing war-torn Vicksburg. In May 1863, the Union army took possession of the church for military purposes, and it was desecrated and left in ruins, with only the cornerstone and shards of glass remaining. In 1870, it was rebuilt, the cornerstone was reset, and the broken glass was used to create a unique round window. The present Gothic style sanctuary was erected in 1928, retaining the 1870 structure to serve as the parish hall.