Built between 1838 and 1848 by All Saints Academy as the summer residence of its headmaster, this summer house was associated with the academy's leadership, in which Robert F. W. Allston, governor of South Carolina from 1856 to 1858, actively participated. After some years, the dwelling passed into private ownership. It was extensively damaged by Hurricane Hugo in 1989 but was meticulously restored.