This is a terrible idea, IMO.

For one thing, winning a popularity contest doesn't make you right. And losing one doesn't make you wrong.

But even more fundamental is the idea that when you give someone a vote, its wrong to tell them how they can and can't use it. What type of voting behavior are you planning to criminalize? At the end of the day, youre trying to fine someone for using their vote in a way that you don't agree with. But it isnt your vote, and its not your (or anyone elses) say.