Unless I am defending against a crusade or Jihad, I keep just enough troops to maintain order. Everything else gets dumped into my field armies. This lets you take the fight to them, instead of sitting around with an expensive garrison waiting to get attacked.