Horses should have Inventory space for a Lead.

Next to the saddle and armor, horses (and camels, etc) should have a space for a lead so that you have a lead ready when you go and don't need to think of it. It also does not have to clutter the inventory.

Using Shift+Right Click (or alternatives) you could then simply access the lead that would be directly connected to the horse.