The community was established in 1914 by the Illinois Central Railroad and named for James Harahan, president of the railroad from 1906 to 1911. It was incorporated as a village in 1920 and as a city in 1953. Francis William Mayo served as the first mayor from 1920 to 1922.