That is how hordes work.
If you take their last settlement then they get new stacks. You should try to kill them off when they are a horde and not let them take any settlements. Or you can use your assassins and start killing their FM's.