Yup! pretty standard situation for me. I try not engaging unless it is very obvious that I am involved in the conversation. It doesn't always work, but I try. When I'm at work I tend to leave my headphones in/on as a way to tell others I don't want to be bothered, and as a way to keep myself disengaged from the conversations around me that I'm not part of.