Why not make all the riders invisible, and use the "mount" as the hero. Mounts can have their own attacks, and the riders can be given no weapons at all, so it theroretically would work like a single man.

The only problem with the mount idea, is that if it becomes the captain unit, the game will put an officer on his shoulders.