but if i leave the rest in, in subsequent turns the rest get caught as well.
That's been my experience with shinobi....if I leave them in an enemy province after they've made it past the bf, they will all eventually get caught if I don't move them.