Thats exactly why i always play on vh/h.
Your own men rout only they smell an enemy, while the enemy soldiers stands and fight to the very last man.
A bit unrealistic if you ask me!
So my advise would be to not use any harder settings than hard when choosing battle difficulty before starting an campaign.
Bookmarks