Use them as opportunities to groom potential adoptees or husbands. Take out "captain" led armies to subdue, and the guy might make an excellent governor later.

I think this brigand creation might be related to the "unrest" stat, but I haven't tried to quantify it yet. It could also be caused by spies or assassins wandering around the land.