Built of sand limestone and cap limestone from a nearby quarry, this Greek Revival residence was constructed as a farmhouse and also served as a halfway house for travelers between Milwaukee and Prairie du Chien. In 1848, Alexander Smith bought this land, which had been surveyed for the U.S. by Lucius Lyon, an early speculator, and he erected the house, which remained in his family until 1920.