The mansion was erected in 1883 by Captain George Flavel, a pioneer Columbia River bar pilot and business leader. It served as the family home for fifty years. His great-granddaughter, Patricia Jean Flavel, presented the property to Clatsop County as a memorial to the Flavel family of Astoria, and the Clatsop County Historical Society restored it as a historical museum in 1951.