RATIO is a large-scale benchmark that defines retrieval relevance through three ideation operations: Address (retrieves approaches for problems), Broaden (retrieves general formulations), and Specify (retrieves concrete instantiations)

We introduce RATIO (Retrieval Across Typed Ideation Operations), a large-scale benchmark in which relevance is defined by three operations which we name ideation moves: Address retrieves potential approaches for stated problems, Broaden retrieves more general formulations, and Specify retrieves concrete instantiations.

http://arxiv.org/abs/2608.27394v1