I agree with Blitz. When nazi liked german culture, should we ban it? Should we ban niebelungenlied, norse sagas or artworks of romantism containing german mythology? No, it would be crazy to ban it. And only because someone ill-minded liked it you cannot like it too without being silly like nazi?
But I also agree that it is better to don't use swastika and not have to solve problems about it.