Ashley House, built in 1820, stood within the span of 1670 to 1970 history and was occupied by Federal troops on Feb. 5, 1865.