Just have effective governers ready to pacify the province. I think extermination isn't such an effective way to increase public order. I'm quite sure it forces unrest through the roof.