Spencer House was a popular rest stop on the Louisville-Taylorsville stage route and for many years was a famous hotel and tavern. Built about 1838 by Frederick B. Mathis, this 20-room brick structure was later owned by Confederate veteran Isaiah Yocum, who settled here after the Civil War. For 58 years, he and his wife Kate served guests, calling them to meals by a bell atop the hotel.