Downvoting is quite negative if it is done out of malice... When you downvote just because someone else downvoted you first...

I mostly downvote low quality comments made by bots, or people who write low quality posts just because they know enough people will upvote all comments and posts made by high reputation people to get more rewards for themselves, so eventually they also get high reputation faster.