He fears that if he remains in the room he may have to open it again, and that Mrs. 168 Inglethorp might catch sight of the letter before he could snatch it up. 
His biggest fear is staying in the room and having to open it again. 