Psychedelics are very obscure in that manner. I used them for years in copious amounts and never experienced anxiety or paranoia, but then one day it all changed and I became extremely sensitive to these compounds and how they affected my chemistry. I'm a headfirst individual myself. Its difficult, but so much more rewarding, imo.