John Edward Holla was born in Albany before the Civil War, one of seven children of Charles and Augusta Holla. His father, a German immigrant, moved the family to Sing Sing, later Ossining, and worked in the prison shoe shop. Known as J. Edward, Holla became a keeper at Sing Sing Prison in the 1890s and worked there in several roles, including chief clerk, for the next 20 years while also building a career in local politics. He was elected to the village board in 1897, served as village president in 1901 and 1902, and because Sing Sing changed its name to Ossining at that time, became the first President of Ossining. He later served again as president from 1913 to 1914. As village trustee and president, he supported a new firehouse on State Street because residents feared the south end of the village, including the first Ossining Hospital on Orchard Street, stood too far from existing firehouses and was vulnerable. He held the first meeting of the new fire company at his State Street home, where he lived with his wife Antoinette Van Wart, a direct descendant of Isaac Van Wart, who captured Major Andre during the Revolution, and their daughter, Edna May. Holla Hose Co. No. 5 was named in his honor, and he served as its captain and president. From its position on the cliff above Sing Sing Prison, the company answered fires there until the prison established its own fire brigade. Holla also began the annual inspection of all companies in the volunteer Ossining Fire Department, a tradition that continues today.