Caledonia County was set out from Orange County in 1792, and Peacham chose to provide a county grammar school rather than a courthouse. The Caledonia County Grammar School, also known as Peacham Academy, was chartered in 1795 as the third county grammar school in Vermont, and classes commenced in 1797. Among the notable people educated there were Thaddeus Stevens, an abolitionist and Pennsylvania Representative to the US Congress, and George B.M. Harvey, Ambassador to Great Britain. More than 3000 students from Peacham and other towns, states, and countries attended Peacham Academy. The school closed in 1971, and the Academy building burned in 1976.