Taylor House was built in three stages from 1825 to 1871 using stone quarried on-site. William Taylor owned all Middleport land south of the canal east of Main. The house is listed on the U.S. and N.Y.S. Historic Registries.