A former Second Lieutenant in the Hungarian Army, Zoltai was an accomplished athlete having competed in the 5,000-metres event at the 1948 Olympics Games in London. His Olympic involvement would continue 28 years later when he served as an official for the modern pentathlon at the 1976 Olympics in Montreal.

In 1967, when community colleges across the province began operations, Zoltai was part of a group of seven athletic directors that founded the OCAA. During his 18-year tenure overseeing Fanshawe Athletics (1964-85), the Falcons won 28 OCAA titles (87 medals in total) and three Canadian titles. In 2003, the OCAA inducted Zoltai into its Hall of Fame.

To recognize Zoltai's great contribution to Fanshawe athletics, the College - with additional support from family and colleagues - established the Les Zoltai Award upon his retirement in 1985.