There appears to a ratio of family members to provinces that the game does not want to let you go beyond. This might be the problem.