I don't think it destroys buildings, it just concentrates on replace ones that are not of your culture when it can...

But if you set that mode and destroy the buildings your self it will...

Add to that it is far more worthwhile to upgrade a fairly advanced alien culture building when you can, rather than destorying it and rebuilding from scratch...