Actually the voters would be known a priori as well. It's just that the way they vote would be blinded until the reveal stage of a round. Short of redesigning the system and using fancier cryptography (e.g. RingCT) to constantly mix "bandwidth coins" (for lack of a better name), the submitter of any transaction (including the vote commitment transaction) must be publicly associated to an account on the blockchain.