you're right, distance from the capital is a significant factor, but there's not much you can do about it, except for using remote cities only as slave farms and easy money (by exterminating the populace).
However, what you _can_ do about corruption is build buildings that improve the law, and/or transfer characters that add to your governor's +law from places where they are not needed as much.