I don't think you can destroy those buildings without a CTD. If you're having trouble keeping a settlement under control, just exterminate it.