You have to defeat armies with cavalry in them a certain number of times. After that, you get a message that you can now build them. Same goes for gunpowder. When you get them both, and have killed a lot with them, you get the "mounted thunder braves", basically a VERY good unit on horses with muskets.

Hope that helped :)