Actually it is possible to add more than +1 in one upgrade, but maximum is +3 at all. So you can have unit with 0 armor upgraded to 3 leather, but you will be not able to upgrade it more.