The Shelley-Howerton House, the oldest house in Sugar Hill, was built in the 1860s as a saddlebag house with two rooms and a central chimney, and later additions turned it into a gable winged cottage. In 1883, William and Elizabeth Shelley purchased the home with 249 acres. The family owned gold mines on Level Creek Road until 1941, when the Amphlett brothers acquired the business. The mines produced high quality ore, but they were costly to operate. Charlotte Howerton, granddaughter of William and Elizabeth, lived in the home until 2015.