Im guessing culture penalty. Try destroy all the unnecessary buildings like enemy barracks. Until your cities turn in to your culture, reduce tax rates to the lowest.