HA are as fast as light cavalry, so unless playing for a long time with the map borders, they can't be caught.

So far, the only reliable way I've found to kill them, is to use superior foot archers.