No, he waits until he has had a violent quarrel with her, of which the whole household is cognisant, and which naturally directs their suspicions upon him. 
Everyone in the house knew they had just fought. 