Surveyed in 1663 as Holland’s Hills for Francis Holland, Holly Hill was bought in 1665 by Richard Harrison, a Quaker planter and shipowner who owned about 6,000 acres. The house was built in three stages between 1665 and 1733 by Richard Harrison and his son Samuel, and it is one of the largest and best preserved houses of its period in Maryland.