Not really.

Rally troops has 2 functions.
1 is to boost very slightly (around 1 point) of morale to nearby units.
2 is to stop units already routing from continuing to rout. This only works if the unit is not near any enemy unit and is not currently taking losses. Also, there is a minimum amount of time a unit routs. Something like 10-20 seconds or so.