As far as I can tell retraining one unit at a time while not building new units seems to maintain the level of experience More than one seems to dilute the unit with fresh recruits. On huge scale I've had a cavalry unit knocked down to 20 men or so with 1 gold chevron After retraining the chevron remained intact.