I don't look for a difference. I just avoid people wearing things like that.

However, if was concerned about such distinctions, I would look at the person's body language; or if they were speaking, listen to voice tone. People who want to interact and people who don't will behave differently.