I actually managed to do this accidentally once. I was fighting the Getai, and only planned to take the towns necessary for my victory conditions, then let the faction live. But then in the last battle for the last town, they sent in their remaining two FMs. I didn't know, so I killed them both. Too bad, but hey. At least i didn't have to defend against endless stackspawn on that front.