Aaron Phelps, a pioneer settler and Milford’s first postmaster, built this Greek Revival residence between 1836 and 1838 as one of the first frame structures in the village. In the early 1840s, New York immigrant Ira Hibbard bought the house and turned it into a tavern. For many years it served the Milford community as a tavern, stagecoach inn, and mail drop on the Pontiac-Howell stage line. During the 1860s, it was converted back into a private residence.