I have tried that hypothesis and its not spies. Even islands (like Rhodes) have this problem, not just mainland cities and when I got fed up with it, i made 3 spies for each settlement and gave them skill 10 quickly, ended turn twice to check whether there was a spy inside and nothing. The unrest stays. I'm guessing its related to some campaign script or some situation your nation must be in?