I'll add, a fort with a militia or peasant unit can also suppress annoying rebels, so you can spare upkeep on an army to fight them, in heartland troop production areas.

Actually, not dealing with rebels might also lead to financial troubles, they may stymie trade, and also be doing damage through devastation if they are left unmolested.