Eight miles east, Kingston was settled in 1773 by North Jersey pioneers led by Richard and Samuel Swayze. Samuel Swayze later formed a Congregational church, reputedly the first Protestant church in the state.