One mile southeast lies the site of Old Jersey Settlement, now known as Kingston, where settlers from New Jersey organized the first Protestant church in Mississippi with Samuel Swayze as pastor.