Yeah, having the same 5 or so Imperial units available in say, five different colors representing 5 cities/province would really suck up unit slots.

Gameplay wise, I'm fairly sure there's a way to make this possible, it's just that those slots could probably be used for something else.