It means that you can shout at them till you're blue in the face, but they still won't be loyal....

No, actually, I think he means the icon that appears on the little information strip below the city name. Loyalty is reresented there by a face icon which is coloured (lowest to highest) red, blue, yellow and green.