The pre-Revolutionary center section of the building was the home of Cornelius Ludlow, a colonel in the Eastern Battalion of the Morris County Militia and later a Morris County judge.