Jihad on my land - a bit of a dilemma?

[DirtyACE]

I'm playing as HRE using Stainless Stell 5.1 mod. Egypt calls a Jihad to capture Constantinople, so Egypt, Turks, and Moors all send their jihads. The Moorish Jihad, however, is traveling from west to east and is going through catholic lands. I did not notice it until it actually arrived on my territory (but it had to have traveled through Spainish and French lands), however, Constantinople just fell to the Turks and the jihad is over, so now I have a full stack Moorish army standing on my land. My dilemma is to whether to destroy them or give them a chance to just leave in peace. The reason that it's a dilemma is because I'm allied with France and they are allied with the Moors.

Any suggestions?