The Masterson House, the oldest brick house still standing in the county, was the home of Richard and Sarah Masterson, with bricks laid in Flemish bond. It was the center of the town's activities, and because the Mastersons were leading Methodists, they opened their home for services before a church was erected in 1810. Richard Masterson was among the early trustees of Port William, now Carrollton, which was incorporated in 1794. The first court of Gallatin County was held here on May 14, 1799. Bishop Francis Asbury visited "Widow Masterson" in 1808. Sarah and Richard Masterson are buried in the family cemetery nearby. The house was listed on the National Register of Historic Places in 1975 and was restored by the Port William Historical Society in 1979-1980.