Good point, though it's usually easier to just use move_character to clear out the old garrison, rather than attacking them.