I think, it has to do with the faith of your faction leader. BTW, why would revert back to paganism?