Oliver H. Perry and his wife, Frances "Fannie" Perry, built this house in the mid-1850s. Frances was the daughter of Robert and Mary Sappington Scott, the largest landowners of what became Camp Nelson. The Perrys built the two-story, 14-room house in the Greek Revival style, with wide bands of trim beneath the roof line, porches, prominent columns, doorways with side and transom lights, a two-story entry porch supported by square columns, and well preserved interior features including doors, windows, wood trim, and mantles. When the U.S. Army established the supply depot here in 1863, it seized the Perry home and referred to it as the "White House." Quartermaster and commissary officers, including Chief Quartermaster Captain Theron E. Hall, lived here, and Hall signed his name on the parlor wall. Records indicate that the army built all or part of the two-story rear addition during its occupation. After the Civil War, Oliver and Frances returned with their sons Robert and John. Oliver became a prominent farmer, and John Perry and his wife, Tabitha Roberts Perry, continued to live in the house after Oliver and Frances died. The house remained in the Perry family until 1948. Jessamine County Fiscal Court purchased it in 1997 and completed its restoration two years later. During that restoration, after years of under-maintenance as rental property, workers discovered Civil War graffiti beneath the parlor plaster, and part of it was preserved.