Portaits that are assigned to people who come of age or those that are adopted are random. It is impossible to assign portraits (midgame) based on traits or anything, for that matter.