One of the big problems is that while there are agent limits, its not an overall agent limit, its a limit for each type. So if you have a limit of 3 of each type, thats still 9 total agents and that is a lot. I think it should be an overall limit, so if you want 3 spies or 2 spies and a champion thats fine, but 9 total agents is kinda crazy.

That or severely limit their capabilities. Like maybe only spies can assassinate and poison wells, champions can only duel and train your troops, and dignitaries can only change culture and concert enemy agents. Right now they can do a bunch of different things that when you combine them all together its crazy, but when limited its a nice feature.