Cardome was the home of Governor James F. Robinson from 1844 until his death at age 82 in 1882. He succeeded Beriah Magoffin, who resigned as governor in August 1862 after refusing Lincoln's call for troops. Robinson supported the Union during his year as governor. He was also a lawyer and a jurist of distinction, and he served as a trustee of Georgetown College from 1831 to 1881 and as president of its board from 1864 to 1881. The house was built in 1821 and became Cardome Academy in 1896.