Built in 1822, the Bay View School originally stood on a triangle of land in Great Hog Neck, where the Hallock family leased the site to School District No. 6 for one peppercorn a year. Children studied reading, writing, spelling, arithmetic, geography, and history there, bringing wood from home to heat the building, using kerosene lamps in wall brackets for light, and drawing drinking water from a pump in the yard. Before chemical toilets were installed, girls and boys crossed Bayview Road to use a privy. The school closed in 1926, and the building was later turned into a machine shop on the Dickerson Farm. In 1990, the Dickerson family gave the building to the Town for Southold's 350th anniversary, and it was moved to its present site in April 1990, where it was restored and refurnished.