Walter Brown was raised in Bemus Point and first gained sports-page attention as a Bemus Point High School pitcher with no less than eight no-hit performances. He graduated from Bemus Point High School in 1933 and continued his baseball career with the St. Louis Browns in 1936, a team that later became the Baltimore Orioles in 1954. He finished his career with several no-hitters and was noted for playing on winning teams. Walter and his wife Francis were married on June 23, 1939, in a ceremony at home plate while he was playing with the Kilgore Boomers in Kilgore, Texas, before 3,000 fans. During his baseball career, Walter and Francis settled in Oriental Park in Bemus Point, New York, where they raised four sons, Barry, Timothy, Brian, and Thomas, and a daughter, Laurrie.