Would he withdraw to his castle if I beat him in played out battle?
You can make sure of it, just don't kill him

Getting him under siege is THE crux of this strategy, for unless you do that a state of war will continue, and along with it your excommunication. Also you're not trying to avoid a re-emergence anyway, as wiping him out then letting him re-emerge means he'll have no navy.