Not sure about family lines, but I know that an heir I nullified in favour of someone less awful became very unloyal very quickly after the nullification...