Union troops seized the town in March 1862. Efforts to recapture it failed in 1862 and 1863. The Union army withdrew in April 1864.