I had the same problem: a Jihad was entering into a rebel province -> Exit to desktop. I fixed it by attacking this province and bribing the commander of this province.