 Irene Whitney died of lung cancer in 1986.In 1990 Whitney married Penny Lewis, a professional horse trainer, from whom he was divorced in 1994.In 2005, he married Chief Justice Kathleen A. Blatz, of the Minnesota Supreme Court.