Smith’s Tavern served as Revolutionary War militia headquarters in 1779 and later housed the first town post office and the North Castle town meeting place from 1798 to 1850.