The Town of Brutus was formed from Aurelius in 1802. The first settlement in the town was made by Aaron Frost in 1795, and he built the first grist mill.