Natural selection is a resourceful tinkerer and could have rewired men's brains to respond to lowered testosterone in any number of ways, not necessarily by becoming less competitive.
Natural selection might have made men's brains respond to lowered testosterone.  