There haven't been too many titles lately with a really good AI.

In addition to what Red pointed out, it's worth mentioning that the more complex the game, the harder it is to do a good AI. Games are getting more complex, and AI programmers are struggling to keep up.

The TW series has it even worse, because you effectively need TWO AIs, one for the strategy map and one for the tactical map. Must be a nightmare.