Culture Penalty

Hey guys, I am playing my Julii campaign, and I find that Patavium is rioting every year, even though I've held it for 20 years or so. According to the settlement report, the level of culture penalty is at 40%. Now, I did destroy the Gaul temples that were there when I had taken the settlement. But, do I have to destroy the other Gaul buildings (such as the warrior's hold) too in order to get rid of this penalty?

On a related question, the squalor is at 55% in Patavium, and I have no idea as to how to lower it. Any ideas?

If there is a tavern there you have to destroy it, unless you want to wait 50 years foe the culture penalty to go away.