I would rather make the recruitement of the local militia easyer. We had that topic before, assuming that a conquerer who is moving far beyond his homelands would immediatly grap what armed men he could find on the spot to have a garrison and fill up his ranks.