Prediction-powered evaluation provides data-efficient system comparisons that are provably unbiased by combining limited human judgments with large-scale automatic scores

we propose prediction-powered evaluation, a framework that combines limited human judgments with large-scale automatic scores to obtain data-efficient system comparisons that are provably unbiased.

http://arxiv.org/abs/2608.26638v1