my opinion is just an opinion of someone who faced similar situations in real life. Somehow somewhere along the way, I had to " attend" a war and it set me back a few years in my academia. Suddenly the world was full of haters who told me I was good for nothing. I had to give up 4 months of my life being emotionally depressed and a wreck. That's all I lost and that loss was the greatest thing that happened to me. I put my head down and focused and worked like a maniac. I am extremely successful in my field. I may have never risen to these heights of the setback had not sent me springing forward.
Now I see haters as a springboard. Accept the challenge and focus. The battle is not with them but with your own self. Keep your score in your head and don't ever leave again. I expect you to be only stronger with time. Best wishes and Godspeed.