An easy way to get rid of bad retainers is to give them to a general who is about to die. When he croaks his retainers go with him. I tend to weed out some lesser retainers if my regular generals are near full in case I get more.