In realistic conditions with self-selection and drift effects, compositional online learning achieves approximately 8x improvement on LLM query costs

Self-selection at the cascade boundary, sample-budget shrinkage, and selectivity-estimation drift reduce it to a realistic figure near $8\times$.

http://arxiv.org/abs/2608.27244v1