 Spalding was later accused of having an affair with both sisters though the allegation was questionable.The potential for scandal cost Spalding appointment to the See of Chicago and he remained Bishop of Peoria.