I seem to recall seeing some infantry moving slower than the cavalry once, but then the cavalry had such a loose turning circle that they were literally running circles around the men!

I agree that the speed needs to be fixed... Mowing down defenceless infantry was my favourite part of Medieval!