The first church on this site was built in 1695, and the present structure was completed in 1765. The Reverend Henry Hall (1675–1722) served as the first rector from 1698 to 1722. From 1786 to 1792, Saint James’ was the home parish of Thomas John Claggett (1743–1816), the first Protestant and Episcopal Bishop of Maryland and the first to be consecrated in America.