Ideally, I would see some option to give the AI "captain" a command along the lines "hold this position, doing your best to keep the formation I arranged" while I manouver the cavalry. Or ask the captain to march a portion of the army somewhere defending more or less intelligently. But I might be dreaming here.