"Often Retreats" is one of the "coward" line of vices, which affects morale. Also you were outnumbered more than 3 to one which, IIRC, also affects morale.