Be careful because the army cost is divided up among all your cities based on population.

So the larger cities end up paying more for your troops. If most of Patavium's expenses are military then letting the city go will only increase it somewhere else.

I have a few of my big cities making terrible loses, but they're propped up by the smaller cities that dont pay for much.