I've had the same sort of scenario happen, except the castle guards didn't just disappear -- as you'd expect they stayed in the castle.

No idea, that is an odd one.