build law buildings (town hall series, walls too i think) and/or have a general with some law traits as well, will reduce corruption.

If you start building it, check the settlement details, and you should see some of the corruption blinking, that tells you how much the difference will be when you get done building it (approximately though)