LLM compute accounts for 80-90% of query cost in production semantic data processing systems

In production, LLM compute accounts for $80-90\%$ of query cost

http://arxiv.org/abs/2608.27244v1