Xiaohong Qian

Towards Optimal Speculative Decoding: A Comprehensive Survey on Optimizations and Future Directions

Speculative decoding (SD) has emerged as a compelling approach to breaking the sequential bottleneck of autoregressive large language model (LLM) inference. By coupling lightweight drafting with parallel verification, SD reduces expensive target-model decoding while preserving ge...