Well, I had a reasonably good Jihad against the Byz ruler, from a 24% zeal Egypt. It was enough to send him packing.

But it really does take some time to build up zeal. A jihad should technically be available automatically in any province since it is the potential of every citizen , be he peasant or Prince, to fight in the Cause.