In 1920, Idlewild’s founders, Wilbur Lemon, Alvin Wright, brothers Erastus and Adelbert Branch, and William Jennings formed the Idlewild Lot Owners Association, which was responsible for public improvements and maintenance of the resort and also promoted fellowship and community pride. Sunday forums featured speakers such as fellow resorter and author Charles Chesnutt. In 1934, the Women’s Club of Idlewild merged with the association, where women often assumed leadership roles. The association hosted fashion and variety shows as fundraisers for improvement projects. In 1954, it purchased this site and began developing youth programs, and this building, the Robert Riffe Youth Center, opened around 1962.