There is an other option. When they run out of arrows they seem to forget that they are skirmishers. They like to think that the have become spectators and are not longer taking part in the battle. If you don't withdraw them manually once they shot their last arrow they can get caught by armed turtles.