No less likely than a single spy being able to open every single gate in a fortification. It's not realistic, so don't worry about it.