I understood that he wasn't complaining about cities growing too large, but cities shrinking.

Well, shrinking isn't the worst, believe me. I recommend to build Aquaeducts, if they are available for Lusitanians. Just take a look in the buildings description, they tell you which building increases population growth. Generally buildings that reduce squalor reduce unrest as well.