Provinces with or without governors tend to have unrest as long as they are far away from my capital (with type 2 govs even). But maybe you are right - VH/VH might make things harder, regarding unrest. Need to test it out.