Ladders are death! I have run off Venetian Heavy Infantry with a cheesy HRE spear militia. I recommend using ladders only against unmanned sections unless you just want to use an "expendable" unit to cause a diversion. (Varangian Guard would most likely do quite well against peasants and poor militia or weak melee archers.)