How do you actually ride your mount?

This is probably a dumb question, but I can't figure out how to actually ride my mount. I have been trained in Riding, and I bought the horse for 7k-ish early in my run. However, clicking on the horse, even with the middle mouse button, just brings up "talk," "kick," etc.