In the 1840s, Jesse Walling, a veteran of the Battle of San Jacinto, set aside four acres for a church, school, Masonic lodge, and cemetery for the Liberty Hill community, later renamed Millville. The cemetery contains nearly 400 graves, many unmarked, and Ann Rushing's grave, dated 1851, is the earliest marked burial. Her grave and five others are denoted by carved fieldstone covers, which, along with other early stone features, give the burial ground a unique appearance. Descendants of those buried there formed an association that holds the annual Millville Picnic, a tradition dating to at least 1885.