I wonder, did the big mods like Europa Barbaorum, Rome Total Realism etc... feature improved AIs ? Because if that's the case, it might be simpler/faster to just borrow their ideas and work on an already improved basis.
The AI logic itself was not modifiable in RTW, though some improvement was possible by modifying the formation files and changing the game enviroment to better suit the AI.