See, I never have that problem. And here's why:
1)I do not think many people in my country are realy that odd.
2)No one tries to screw around with a large guy with a rifle slung across his back, a pistol (in a holster) and a kukrhi on his belt. Plus if I am wearing a unifom, then it is even dumer.
3)If I did get in a fit, I fit for a living, so I do not worry about it.