Majority-vote pseudo-labels are fragile because an incorrect vote corrupts the teacher and misleads every token

Replacing ground truth with majority-vote pseudo-labels is a natural alternative, yet it is fragile: an incorrect vote corrupts the teacher and misleads every token

http://arxiv.org/abs/2608.27448v1