Remember that the second Turks start beating the Byzantines the Pope will Intervene by launching Crusades so it might not be as easy as it looks.