For each chevron the unit gets +1 morale. On bronze chevrons, you also get +1 attack/defense skill. +2 of each on silver, +3 of each on gold.

The morale effect is by far the best. Peasants with all 9 chevrons have more morale than Knights Templar....