Self-consistency, self-refinement, Best-of-N, and training-based methods have cost and latency trade-offs that are important to understand.

Readers see how self-consistency, self-refinement, Best-of-N, and training-based methods actually work, including their cost and latency trade-offs.

https://x.com/KirkDBorne/status/2093920234675507487