It's awesome that they've never harassed your generals! One Inquisitor with a piety of 10 butchered my Faction Leader and several of his benefactors. This destroyed my family tree, but thankfully I recovered.