I'm playing as the Moors currently. I attacked Portugal and Spain and was still mixed. I attacked Sicily and from what I remember, I was either still mixed or became untrustworthy. Milan attacked me and I counterattack them and I became dubious. It's odd how counterattacking a nation that declared war on me dropped my rep larger than me declaring war.