The congregation was organized in 1740 and is the oldest of this denomination west of the Hudson River. The church was built in 1856 and is notable for its Greek Revival architecture and rare interior Trompe L'Oeil painting.