I would never have dreamt of suspecting the doctor, had not Poirot put it into my head. 
The doctor was the least likely person that anyone would expect to have done this, and that might even make it more possible that he did something like that.