I had same problem with Julii, 50 provinces and less than 40 family members! It was always a struggle to get family members, they were producing daughters most of the time and the cows wouldn't get married! There must have been some bad mojo running in the family...