Once he has slept with a woman, the animals refuse to associate with him; he cannot go home again.
Even if the others want the animal to come back home, he refuses to because he has slept with a woman.