The morale penalty helps, and particularly if your using long ranged gunpowder units (Camels of DOOM, or musketeers). Try using handgunners, and i bet you they will end up stomped by just about everything.