If anyone else interested in the challenge wants to I'd be ok with it.
Otherwise, not a big deal, especially with the early limits on expansion.

Can cities without governors be controlled by the computer, or does "no building" mean not letting the comp build for the town, either?