From 1856 to 1888, Denny Hall was the first high school in Spencer. It was named for Charles Edwin Denny, who gave two thousand dollars toward the construction of the school. In later years, the cupola on the roof was removed, and the building is now private property.