It seems that you can get castle-only guilds in cities and vice versa when you convert them. The guild "score" remains even when the settlement has been converted to another type, so if you gain a few more faction-wide points you will go over the threshold and get offered a guild, regardless of settlement restrictions. In this way I received swordsmiths for Palermo and Toulouse, and horse breeders for several castles.