I don't think the game will let you have more family members than cities, once you get beyond the start.