Settlement buildings arent limited to cultures, so I'm not sure what you're working around. Unless you're talking about strat map models, in which case, no you cant define them by faction.