Depends how tough you want to make it for yourself? If you'd like to be the flaming horde of doom destory everything...but maybe just gov buildings. Keep MICs and other buildings as it's hard enough generating enough money as a nomadic faction.

When I play KH or Romani I like to Hellenize/Romanize every province I take by smashing every single building down and starting a new!