Maybe you "accidentaly" forgot your guys inside a city with a lvl 4 government, thus giving them the "Client Ruler" trait? It has happened to me and it seems only FMs with the "Family Member" trait are immune to that little "bug".

Maion