Human evaluation for non-verifiable tasks is reliable but expensive, while automatic metrics are scalable but often biased

Across various non-verifiable tasks, human evaluation is reliable but expensive, while automatic metrics are more scalable but often biased.

http://arxiv.org/abs/2608.26638v1