The church was built by Congregationalists and sold to the Baptists in 1861. Its steeple served as a landmark for captains looking for the customs house located in front of the church from the mid to late 1800's.