More than 5 total armor (including bonuses from your master armourer) and your units will tire much more quickly and be unable to recover.