If you have a building that allows for free upkeep of units it will only apply to units that have the fre upkeep ability and that can be trained in that settlement.