Having lost a few battles your general will have a whole bunch of vices that will be negatively affecting your troops.
He must have run to lose so many battles.
He quite possibly had developed several bad traits already over his career.

If you have a variety of troops consisting of mostly light troops + highly negative general vs 10 elite, upgraded swordsmen then you can expect to lose.

Give us more precise info about your & the enemies army make up (unit names/experience/upgrades/general traits etc)

Try just sitting back & shooting them?