Most existing math benchmarks evaluate only final answers, providing limited diagnostic value for identifying process-level failures

However, most existing math benchmarks evaluate only final answers. This outcome-oriented evaluation provides limited diagnostic value for identifying process-level failures or rigorous logic, failing to guide the transformation of LLMs into robust agents.

http://arxiv.org/abs/2608.26950v1