If you have a plague in a province, I think you should lose some of the troops in that province to the plague.

In the 100 years war, the first half of the war featured English armies of 20-25,000. However, after the plague hit England, their armies were under 10,000 men.