Henry E. Bryson's home included the first log cabin built in Bryson, Texas, in 1878. Henry E. Bryson moved there with his wife, Mary A. Bryson, and three of their children, including Anderson Doak Bryson, Kate Bryson Moore, and Bessie Bryson Wells. Later, a wood structure was added to the log cabin, and the log cabin area became the kitchen. The Brysons found a board with the name "Elda" carved into it, and this is how Elda Bryson Sewell received her name. Three sons were also born in this house: Henry A. (Abb) Bryson, John Roy Bryson, and Barney Bert Bryson. As of March 29, 1977, the house was still occupied by a grandson, Ozie Moore, the son of Kate Bryson Moore, and Ozie Moore and his wife, Lillie Bell, still used the log cabin kitchen. The children of Anderson Doak and Mattie Ann Simpson Bryson still lived on the same land where the house was built; their names were Ethel Bryson Laird, Elda Bryson Eatherly, and Henry S. Bryson. The names Henry, Mary, Ann, Elda, Kate, and John were family names handed down from generation to generation. Another granddaughter, Katy Bryson Poole, daughter of Bert and Lassie York Bryson, lived in Bryson. Henry E. Bryson died in 1909, and Mary A. Bryson died in 1934.