Built in 1855 by Doctor John Stiles Holliday, this house was connected to prominent Georgia figures including the legendary Doc Holliday, Governor Hugh Manson Dorsey, and author Margaret Mitchell. In the mid 1850s, it served as a dormitory for the Fayetteville Academy, which later gained recognition in Gone With the Wind. In February 1861, a Confederate flag was made here for the Fayette Rifle Grays, the first company raised in the county for the Confederacy. Former owner Solomon Dawson Dorsey served as an officer in the State Militia during the war, and Robert E. Lee Fife and his son Cecil, the last owner, were active in local politics from 1903 to 1954.