Taking away peoples hats is mad. I do not see the point of it.
What if they start wearing, bicorn or tricorn hats, or top hats, or a big Mexican hats, or a big furry Russian hat, or a bearskin like the Royal guards.
Or what if they had long hair and it covered their face.