Infamy is only accumulated if you get caught. And/or escape from the clink. Not like in Fable (which isn't really an RPG) or Fallout. Where if you do bad things your immediatly dealt an evil point.