Considering factions can only join a jihad/crusade for max 10 turns after its called, if you defeat all stacks that have joined the jihad before the limit, the jihad is officially over. Now finding and defeating all those stacks in a problem as the AI doesn't suffer desertion and they stick around endlessly.