Not really. Negative bonuses only offset positive ones, they have no effect otherwise.