the harm caused by undeserved upvotes will be insignificant compared to the damage caused by abusive downvotes.

I agree with this. I'm pretty sure that many people were driven away from the ecosystem by the overly aggressive "downvote wars" of the past. I definitely don't want to see the capability used that way again.

I also noticed recently that there are apparently now services providing "downvote insurance", which complicates the problem even more.