It can feel unlucky when you have a high percentage to success and it fails, especially where often failure leads to death of the agent. I try to use mine no things hopefully they can accomplish, like for example, using an assassin to kill of captains of bandit units.

Fortunately recruitment of agents is not all that expensive so in the end I deal with their occasional failures by simply hiring a bunch of them.