I think that the limits of free speech are the same as the limits of free choice: when what you say or do will harm others (e.g. threats, inciting violence, libel), then it should not be allowed, otherwise it should.