 Frustrated with the growing rate of penalties, a group of owners sought to have Ray fired, but loyalists including George Halas defended Ray.Ray resigned as the NFL's technical adviser in May 1952; he said at the time that he no longer felt he could physically do the job.Ray was married to Charlotte Johnson (sometimes known as "Lottie") in October 1908.