I thought it was their lack of threat that made them stay in it to the late game. I always thought other factions thought they weren't worth the bother of conquering.

I guess one of your traits would be Cruelly Scarred, Titus Livius ?