You can, Doug. However, if it's a guild hall you can't have it won't give you any benefit. If you as England take over a Spanish castle that houses a chapter house of the Knights of Santiago, you won't be able to recruit them there. I now have a citadel with an academy in it, in my Venice campaign, but it won't let me build agents there.