I know exactly what you are talking about, as I was experiencing very same a few years ago. In hindsight, I recognized for myself that the root cause for this inner uncomfortability was that my energy and beliefs were not in resonance with theirs. It didn't require any conversation to find out what makes them tick, I simply felt it. So basically, their energetic footprint intruded my very own energetic footprint. And my consequent feeling of discomfort was merely telling me that I don't want any external energy or belief to be imposed over me. Instead, I should follow my own energy and beliefs. As I became more aware of that step for step, and followed my own energy and beliefs, not only did I receive internal proof that this was the right choice but I also noticed that my inner beliefs and and energy became more resilient and steadfast. This way I naturally started becoming more comfortable with such situations because my energetic footprint was more difficult to be intruded by others.

Thanks for sharing and best wishes! :)