Minecraft wiki entry for Development_versions, associated text: Added a UI to control saddle/armor.
Can be accessed by sneaking and right-clicking, or by pressing the inventory button while riding.
Some features of the UI are specific to situation:
Horses have a saddle slot.
Horses have an armor slot.