Another big difference is that the Roman cities are big and their empires large from the beginning.

This means as a non-Roman, you face a steady stream of top Roman troops from the beginning of the game. I have been playing a Saxon game where I have to fight off a decent roman army (some with 3-4 legionary first cohort units) every turn.