All that springs to mind is moving your king as far away as possible and removing all your forces from that province. I think that destroying buildings only helps if they are loyalty boosting buildings.