The Hartsville Passenger Depot was built by the Atlantic Coast Line Railroad in 1908 as an example of an early 20th-century passenger depot. It served the town until 1940, when the Atlantic Coast Line discontinued passenger service to Hartsville. In 1948, the depot was remodeled to house the office of the Chairman of the Atlantic Coast Line Board. Former Atlantic Coast Line Chairman A.L.M. Wiggins continued to occupy the office until his death in July 1980.