Newburgh was the first town north of the Mason-Dixon Line to be captured by Confederate forces during the War Between the States. Brig. Gen. Adam R. Johnson and a guerrilla band crossed the Ohio River and confiscated supplies and ammunition without a shot being fired.