I think harvest amounts are effected by loyalty, a constant recurrence makes me think you need a few more men in each province. I know it's been said, but add a few ashi's in each province, they're cheap to sustain and they'll get you more money in the long run. It's a waste to send ashi's into battles - yes they may die for honour but they prove more valuable by garrisoning your own lands.