just use buffed steppe cav and they are faster for pursuit and helluva lot cheaper.

if using heavy normal horse unit, just buy some steppe heavies who can shoot also and have better melee as well as lower reqs.