English
Related papers

Related papers: SJD-PAC: Accelerating Speculative Jacobi Decoding …

200 papers

Coded distributed computing was recently introduced to mitigate the effect of stragglers on distributed computing. This paper combines ideas of approximate computing with coded computing to further accelerate computation. We propose…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Shahrzad Kiani , Stark C. Draper

Large language models (LLMs) exhibit remarkable reasoning capabilities across diverse downstream tasks. However, their autoregressive nature leads to substantial inference latency, posing challenges for real-time applications. Speculative…

Computation and Language · Computer Science 2025-06-18 Tao He , Guang Huang , Yu Yang , Tianshi Xu , Sicheng Zhao , Guiguang Ding , Pengyang Wang , Feng Tian

Current state-of-the-art approaches for image captioning typically adopt an autoregressive manner, i.e., generating descriptions word by word, which suffers from slow decoding issue and becomes a bottleneck in real-time applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Xu Yan , Zhengcong Fei , Zekang Li , Shuhui Wang , Qingming Huang , Qi Tian

Speculative decoding accelerates LLM inference but suffers from performance degradation when target models are fine-tuned for specific domains. A naive solution is to retrain draft models for every target model, which is costly and…

Machine Learning · Computer Science 2026-03-11 Luxi Lin , Zhihang Lin , Zhanpeng Zeng , Yuhao Chen , Qingyu Zhang , Jixiang Luo , Xuelong Li , Rongrong Ji

Speculative Decoding is a widely used technique to speed up inference for Large Language Models (LLMs) without sacrificing quality. When performing inference, speculative decoding uses a smaller draft model to generate speculative tokens…

Machine Learning · Computer Science 2025-02-06 Minghao Yan , Saurabh Agarwal , Shivaram Venkataraman

Speculative decoding is a technique that uses multiple language models to accelerate infer- ence. Previous works have used an experi- mental approach to optimize the throughput of the inference pipeline, which involves LLM training and can…

Computation and Language · Computer Science 2026-03-13 Amirhossein Bozorgkhoo , Igor Molybog

Autoregressive decoding in Large Language Models (LLMs) generates one token per step, causing high inference latency. Speculative decoding (SD) mitigates this through a guess-and-verify strategy, but existing training-free variants face…

Computation and Language · Computer Science 2026-04-17 Zihong Zhang , Zuchao Li , Lefei Zhang , Ping Wang , Hai Zhao

Visual autoregressive (AR) generation models have demonstrated strong potential for image generation, yet their next-token-prediction paradigm introduces considerable inference latency. Although speculative decoding (SD) has been proven…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Haotian Dong , Ye Li , Rongwei Lu , Chen Tang , Shu-Tao Xia , Zhi Wang

Inference efficiency in Large Language Models (LLMs) is fundamentally limited by their serial, autoregressive generation, especially as reasoning becomes a key capability and response sequences grow longer. Speculative decoding (SD) offers…

Machine Learning · Computer Science 2026-02-02 Haoyun Jiang , Junqi He , Feng Hong , Xinlong Yang , Jianwei Zhang , Zheng Li , Zhengyang Zhuge , Zhiyong Chen , Bo Han , Junyang Lin , Jiangchao Yao

Speculative decoding (SD) is a promising method for accelerating the decoding process of Large Language Models (LLMs). The efficiency of SD primarily hinges on the consistency between the draft model and the verify model. However, existing…

Computation and Language · Computer Science 2025-06-02 Longze Chen , Renke Shan , Huiming Wang , Lu Wang , Ziqiang Liu , Run Luo , Jiawei Wang , Hamid Alinejad-Rokny , Min Yang

The generation speed of LLMs are bottlenecked by autoregressive decoding, where tokens are predicted sequentially one by one. Alternatively, diffusion large language models (dLLMs) theoretically allow for parallel token generation, but in…

Computation and Language · Computer Science 2025-11-03 Daniel Israel , Guy Van den Broeck , Aditya Grover

Large language models (LLMs) suffer from high inference latency due to the auto-regressive decoding process. Speculative decoding accelerates inference by generating multiple draft tokens using a lightweight model and verifying them in…

Machine Learning · Computer Science 2025-05-27 Yixuan Wang , Yijun Liu , Shiyu ji , Yuzhuang Xu , Yang Xu , Qingfu Zhu , Wanxiang Che

In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringing significant…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

Accelerating inference in Large Language Models (LLMs) is critical for real-time interactions, as they have been widely incorporated into real-world services. Speculative decoding, a fully algorithmic solution, has gained attention for…

Computation and Language · Computer Science 2025-02-11 Sukmin Cho , Sangjin Choi , Taeho Hwang , Jeongyeon Seo , Soyeong Jeong , Huije Lee , Hoyun Song , Jong C. Park , Youngjin Kwon

We propose a novel speculative decoding method tailored for multi-sample reasoning scenarios, such as self-consistency and Best-of-N sampling. Our method exploits the intrinsic consensus of parallel generation paths to synthesize…

Computation and Language · Computer Science 2025-03-10 Yiwei Li , Jiayi Shi , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Yueqi Zhang , Ji Zhang , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Speculative Decoding (SD) ensures that the output matches the target model's distribution exactly. However, we argue that this distribution matching requirement is too stringent and results in unnecessarily low acceptance rates, limiting…

Speculative decoding accelerates autoregressive inference by drafting candidate tokens with a fast model and verifying them in parallel with the target. Self-speculative methods avoid the need for an external drafter but have been studied…

Computation and Language · Computer Science 2026-05-05 Hector Borobia , Elies Seguí-Mas , Guillermina Tormo-Carbó

Introduced to enhance the efficiency of large language model (LLM) inference, speculative decoding operates by having a smaller model generate a draft. A larger target model then reviews this draft to align with its output, and any…

Machine Learning · Computer Science 2025-07-15 Ziyi Chen , Xiaocong Yang , Jiacheng Lin , Chenkai Sun , Kevin Chen-Chuan Chang , Jie Huang

Speculative decoding has been widely used to accelerate auto-regressive (AR) text generation. However, its effectiveness for visual AR models remains limited due to token selection ambiguity, where multiple tokens share similarly low…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Sihwan Park , Doohyuk Jang , Sungyub Kim , Souvik Kundu , Eunho Yang

Language models have demonstrated remarkable capabilities in reasoning tasks through test-time scaling techniques like best-of-N sampling and tree search. However, these approaches often demand substantial computational resources, creating…

Computation and Language · Computer Science 2026-05-22 Woomin Song , Saket Dingliwal , Sai Muralidhar Jayanthi , Bhavana Ganesh , Jinwoo Shin , Aram Galstyan , Sravan Babu Bodapati