In 1836, a group from Vermont known as the Union Colony settled here and was determined that its children should receive a good education. The Vermontville Academical Association formed, constructed this building, and opened it for classes in the winter of 1844-45. Vermontville was advertised as an ideal location for an academy because there was little to distract students from their work. Because most of the colony were Congregationalists, their minister also served as the academy teacher. Religious services were held here until 1864, when the church across the street was completed. Town meetings were held in the academy, and in 1853 Vermontville’s first general store opened on the ground floor.