from a young age pirmin had developed an appreciation for the fairer sex , and they for him , and so had a tendency to stray from the converted stables that had become the boys home in acres hospitaller fortress .