Or, think of it this way: they're mercenary and they're high nobility. Maybe they performed some sort of transgression at home and were exiled, or they were defeated by a rival tribe and fled, or are simply a collection of non-firstborn sons with a big name and enough money for top equipment, but no actual inheritance.