 Risser was born in Madison, Wisconsin on May 5, 1927 into a prolific Wisconsin political family.Risser's father (Fred E. Risser), grandfather (Ernest Warner), and great-grandfather (Clement Warner) served at various times as Wisconsin legislators representing part or all of Dane County, although none were Democrats.He served in the United States Navy during World War II from 1945 to 1946.