Surely the Casey are hardly what you would call easy? Although I suppose once you've taken half a doven settlements there is little that can oppose you. But then I find that is the same with any faction.