Millstone, originally called Millstone Point and later shortened to Millstone, grew up along the Chesapeake and Ohio Canal. Andrew Jackson, then a general and later U.S. President, met a committee from Hancock here, and Harpers Monthly recounted that as blasts were fired in his honor, Jackson replied to a concerned committeeman that neither he nor his horse was alarmed because they had heard similar music before. During the Civil War, several companies of the First Regiment Maryland Infantry were stationed at Millstone Point to protect the C&O Canal from Confederates. In 1909, Millstone was reported to have a population of 100, with a general store and post office, a harnessmaker, distiller, mason, several carpenters, a teacher, a blacksmith, and numerous farmers in the area. Moffet Station was constructed nearby when the Cumberland Extension of the Western Maryland Railway came through this location.