I've an impression that road development stimulates brigands.
Forts suppress them even if only maintained by a cheap unit like Town Watch, or Peasants.