When Brandon was organized in 1828, part of the town known as Seminary Square was set aside for educational purposes. The first school established there opened in 1829. The Brandon Male and Female Academy, later named Brandon Female College, stood on that site until 1923, when Brandon High School replaced it.