William J. Stafford, one of Stephen F. Austin's Old 300, founded Stafford's Point on the 6819.7-acre land grant he received in the winter of 1824. After bringing his family and slaves from his Louisiana sugar plantation, he had much land under cultivation and a sugar mill and cotton gin in operation by 1834. His manager, Clement C. Dyer, a lawyer, political leader, and later county judge, married Stafford's daughter Sarah. Early residents of the community included the families of Sam Bell, Elijah Roark, Dr. P. W. Rose, Moses Shipman, and Mr. West. Dr. Rose, a former U. S. Army surgeon, tended the sick and in 1834 also hired a teacher for his children and ten other students in a one-room schoolhouse. During the Runaway Scrape of 1836, the settlers and their slaves fled east as Santa Anna's Army camped there and pillaged homes and mills. Stafford's Point was resettled after the War for Independence and again prospered. The Buffalo Bayou, Brazos & Colorado, the first railroad in Texas, was completed from Harrisburg to the village in 1853. From 1915 to 1925, a number of Sicilian families moved there from Brazos County, and Stafford's Point was incorporated into the town of Stafford in 1956.