You can get a revolt if you don't have at least 100 men garrisoning a province. Not sure if this can happen even if loyalty is high though.