My advice would be: don't use cavalry against skirmishers unless you know they are going to break. Their loose formation prevents the charge from landing as hard and their numbers mean that they can easily surround your horses.