Yes I have seen this with some cavalry units that almost got themselves killed. :(

They seem to only do it when they are relatively close to the action.