What about cities, that are larger than 24 000 people and have the foreign governor's palace? Is there antoher way to replace it than to let the city fall to the enemy retake it and enslave the population, so you can upgrade the palace?