This happened to me in my Crusader Campaign and there are only three ways of dealing with it:

1) Destroy the town that's producing them
2) Get lots of cavalry
3) Bring lots of artillery(Mangonels are good).

I chose #3 since the AI will artillery duel you and you can pretty much destroy their army while taking light casualties since siege weapons can be replaced and their untis are fairly hard to hit.