Has got nothing to do with it. Simply ignore them - the reason the game complains about it is because they are client rulers who are no family by definition.