Originally built in 1770, this house stood on land that became a British commissary and hospital, and it has been restored in stages over the last three centuries.