Nah. Good light cavalry wouldn't charge a phanlax, but they wouldn't be scared of it.
And the idea of light cavalry having no charge is foolish. Even a lightly armed man on horse would trample a light footman easily. Have you ever seen a horse? Those things are big, and scary.