Typically horsemen DIDN'T charge into a large formation of men who were firing at them.
Cavalry in this era was NOT the beat-all-end-all it was in the MTW era. It was, actually, approaching obsolescence. A frontal charge against trained infantry was suicide. And even almost unprotected cannons could inflict serious damage of charging cavalry (Light Brigade, anybody?)
Cavalry's use by this point was generally limited to flanking and running down routers. REALLY heavy cavalry and lancers MIGHT risk a frontal charge against an enemy that was already wavering, but if the infantry stood their ground and fought back, they would almost certainly win. A pointy bit of metal on a stick is very effective against a target as big as a horse and cavalryman.
Although, given, troops would have to be well trained to hold against the sight of a hundred men in funny hats screaming and bearing down on them with swords and suchlike.