Mile Square was North Castle’s earliest residential subdivision, laid out by St. Stephen’s Episcopal Church in 1850.