Im having more of a problem with the german phalanxes, they seem to good for beeing build so early. 1 unit on huge can defend a settlement... (or cause lots of trouble getting in.)
EDIT: Remember that they mostly face barbarians and you. (whatever you play as)
Bookmarks