The number of possible children is limited by the province you posses. Conquer more lands, then you will have more children.
Increasing the fertile by trait should help to increase the number also, but there is still a point, where the chances are going to zero.

XSamatan