Well, you don't really have much of a choice in castles, if you're not crusaderhappy, then all you can ever get is swordsmiths guild.

What I'd really like to see, is a good balance between assassins, thieves, merchants, theologians and perhaps horse breeders in cities.