I know that horse archers weren't on your list, but if you want something completely different, try a steppe faction. I found Saka quite fun (once you get over the bit at the start where you have no money), and a real change from infantry battles. You do get some good heavy infantry later in the game, but you have to work for it. Heavy cavalry are there also, and you get to fight against elephants...
Bookmarks