The Railroad Depot was built in 1880 by the Middleburgh and Schoharie Railroad. The five-mile line was established in 1867 and ceased operation in 1936. The depot was later moved here, and the rail yard became a park.