Scholars are Indian gentlemen. And as agents now spawn instead of being recruited(some buildings increase the spawn rate/max amount of agents) you have less of them around.