Speculative cascades — A hybrid approach for smarter, faster LLM inference

Speculative cascades — A hybrid approach for smarter, faster LLM inference