A group of four buildings that now forms the Brick Store Museum operated as separate businesses for many decades. The brick building was erected in 1825 by wealthy merchant and ship owner William Lord. In 1936, Lord's great-granddaughter Edith Cleaves Barry inherited the building and established the Brick Store Museum there. Over time, Barry purchased the remaining three buildings for the museum and eventually connected them into one cohesive block. The building to the left of the brick building was built for merchant Nathaniel Frost in 1793, the building immediately to the right was built in 1810 for merchant Enoch Hardy, the next building was moved here in 1870, and the final building was built in 1814 for Moses Savary.
