I always play on Huge. The battles are more epic and closer to (though still far from) realistic numbers.

Plus, I like depleting my cities. I have never had a problem with running out of people in my cities.

Unit size can be the biggest drain on speed in a battle.