Yeah, I tend to to the same, with the exception of migrations. They rob you of your factional units, which are usually the best you can get.
I usually leave one victory condition territory alone, so I can conquer almost the entire world (with the exception of the far, far East) and then finally capture that territory to get a much sweeter victory.
Bookmarks