What a sad one indeed. I hope he sees this and make amends with you.

Personally, I believe he would have notified you initially before downvoting you. Nobody is perfect. We all learn each day.