George W. Smith erected this building in 1871 to house his family business, where Dartmouth Chocolates and Hanover Crackers were made. Portions of the building were severely damaged by fire in 1884, and Smith immediately rebuilt the bakery and attached a three story addition. In 1888, the factory produced 65,000 crackers a day. Bogle Brothers, the only wholesale jewelers in either New Hampshire or Vermont during the latter part of the nineteenth century, also occupied part of the building, and the White River Paper Company used a portion of it for a brief period. Architect Louis Sheldon Newton carried out renovations in 1904 that are thought to have been the building's last significant extension. The structure was torn down in 1942, eight years after Smith and Son decided to close the business.