In 1863, Confederate Army engineers laid out a fort here to protect Fort Gaines from Federal gunboats, commanding a full view of the river for two miles below. A large magazine of lumber and sand was built about 60 feet from the bluff, with trenches running north and south to cannon, and breastworks were thrown up along the bluff. Below, on the river bank, was a magazine and a cannon. Of the three cannons, one remains at the site. John Seales, Dr. James Mandeville, Dr. Gaston, and Capt. John B. Johnson, a recent graduate of West Point, were among the officers in charge. Because southwest Georgia was not invaded, the fort was never used. After the Battle of Olustee in North Florida, casualties were brought up the river to Fort Gaines, where churches, stores, and other buildings became temporary hospitals, most notably Wayside Home in the old Masonic Building on the site of the present one. Nine unknown Confederate soldiers who died in temporary hospitals here are buried in New Park Cemetery, and a number of Federal prisoners, overflow from the prison at Andersonville, were brought to Fort Gaines and kept under guard in the yard of the old County Court House.