Wearing a hat raises the potential problem of "hat hair" once you take it off. So once a hat is on it has to remain on until you return to the privacy of your own home where it is safe again to take it off and thereby avoid the risk of public ridicule. Those that suffer from "hat hair" themselves will know exactly what I'm talking about.