Fairfield Academy was founded on this campus in 1802 with funds raised by a committee headed by Captain Moses Mather. In 1803 it was incorporated by the Regents of the University of the State of New York, and in 1812 the College of Physicians and Surgeons was established there, continuing until 1839 and graduating 555 physicians. In 1839 the academy continued and was reorganized as Fairfield Seminary for the higher education of both men and women. From 1891 to 1902 it was conducted as a military academy.