English
Related papers

Related papers: Decoding in Latent Spaces for Efficient Inference …

200 papers

Text representation plays a critical role in tasks like clustering, retrieval, and other downstream applications. With the emergence of large language models (LLMs), there is increasing interest in harnessing their capabilities for this…

Computation and Language · Computer Science 2025-12-25 Yeqin Zhang , Yizheng Zhao , Chen Hu , Binxing Jiao , Daxin Jiang , Ruihang Miao , Cam-Tu Nguyen

Large language models have demonstrated exceptional capability in natural language understanding and generation. However, their generation speed is limited by the inherently sequential nature of their decoding process, posing challenges for…

Computation and Language · Computer Science 2024-05-27 Chenxi Sun , Hongzhi Zhang , Zijia Lin , Jingyuan Zhang , Fuzheng Zhang , Zhongyuan Wang , Bin Chen , Chengru Song , Di Zhang , Kun Gai , Deyi Xiong

While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, most LMMs default to verbalizing perceptual content into text, a strong limitation for tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 André G. Viveiros , Nuno Gonçalves , Matthias Lindemann , André Martins

Large language models (LLMs) continue to face challenges in reliably solving reasoning tasks, particularly those that require precise rule following, as often found in mathematical reasoning. This paper introduces a novel neurosymbolic…

Machine Learning · Computer Science 2025-11-19 Varun Dhanraj , Chris Eliasmith

Recent advances in Large Language Models (LLMs) have enhanced text-based recommendation by enriching traditional ID-based methods with semantic generalization capabilities. Text-based methods typically encode item textual information via…

Information Retrieval · Computer Science 2025-11-19 Hao Jiang , Guoquan Wang , Donglin Zhou , Sheng Yu , Yang Zeng , Wencong Zeng , Kun Gai , Guorui Zhou

We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the…

Computation and Language · Computer Science 2024-08-28 Shannon Zejiang Shen , Hunter Lang , Bailin Wang , Yoon Kim , David Sontag

Although Large Language Models (LLMs) are showing impressive performance on a wide range of Natural Language Processing tasks, researchers have found that they still have limited ability to conduct induction. Recent works mainly adopt…

Computation and Language · Computer Science 2024-03-12 Wangtao Sun , Haotian Xu , Xuanqing Yu , Pei Chen , Shizhu He , Jun Zhao , Kang Liu

Deductive coding is a widely used qualitative research method for determining the prevalence of themes across documents. While useful, deductive coding is often burdensome and time consuming since it requires researchers to read, interpret,…

Computation and Language · Computer Science 2023-06-28 Robert Chew , John Bollenbacher , Michael Wenger , Jessica Speer , Annice Kim

Adapting Large Language Models (LLMs) for recommendation requires careful consideration of the decoding process, given the inherent differences between generating items and natural language. Existing approaches often directly apply LLMs'…

Information Retrieval · Computer Science 2024-11-06 Keqin Bao , Jizhi Zhang , Yang Zhang , Xinyue Huo , Chong Chen , Fuli Feng

Large Language Models (LLMs) have demonstrated remarkable proficiency in understanding text and generating high-quality responses. However, a critical distinction from human cognition is their typical lack of a distinct internal `reading'…

Computation and Language · Computer Science 2025-07-08 Yuanxin Wang , Ganesh Venkatesh

Compressing long chains of thought (CoT) into compact latent tokens is crucial for efficient reasoning with large language models (LLMs). Recent studies employ autoencoders to achieve this by reconstructing textual CoT from latent tokens,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xiaoshu Chen , Sihang Zhou , Ke Liang , Taichun Zhou , Xinwang Liu

We introduce a two-dimensional (2D) early exit strategy that coordinates layer-wise and sentence-wise exiting for classification tasks in large language models. By processing input incrementally sentence-by-sentence while progressively…

Computation and Language · Computer Science 2026-04-22 Jan Hůla , David Adamczyk , Tomáš Filip , Martin Pavlíček , Petr Sosík

Low-rank approximations, of the weight and feature space can enhance the performance of deep learning models, whether in terms of improving generalization or reducing the latency of inference. However, there is no clear consensus yet on…

Computation and Language · Computer Science 2024-05-24 Arnav Chavan , Nahush Lele , Deepak Gupta

Recent methods that integrate spatial layouts with text for document understanding in large language models (LLMs) have shown promising results. A commonly used method is to represent layout information as text tokens and interleave them…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhaoqing Zhu , Chuwei Luo , Zirui Shao , Feiyu Gao , Hangdi Xing , Qi Zheng , Ji Zhang

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to move beyond fast System-1 responses and engage in deliberative System-2 reasoning. However, this comes at the cost of significant inefficiency due to verbose…

Computation and Language · Computer Science 2025-06-03 Xiaoqiang Wang , Suyuchen Wang , Yun Zhu , Bang Liu

We introduce a novel framework, LM-Guided CoT, that leverages a lightweight (i.e., <1B) language model (LM) for guiding a black-box large (i.e., >10B) LM in reasoning tasks. Specifically, the lightweight LM first generates a rationale for…

Computation and Language · Computer Science 2024-04-05 Jooyoung Lee , Fan Yang , Thanh Tran , Qian Hu , Emre Barut , Kai-Wei Chang , Chengwei Su

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang

Large Language Models (LLMs) have recently emerged as a powerful backbone for recommender systems. Existing LLM-based recommender systems take two different approaches for representing items in natural language, i.e., Attribute-based…

Information Retrieval · Computer Science 2026-03-03 Kibum Kim , Sein Kim , Hongseok Kang , Jiwan Kim , Heewoong Noh , Yeonjun In , Kanghoon Yoon , Jinoh Oh , Julian McAuley , Chanyoung Park

Currently, inspired by the success of vision-language models (VLMs), an increasing number of researchers are focusing on improving VLMs and have achieved promising results. However, most existing methods concentrate on optimizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Dawei Yan , Pengcheng Li , Yang Li , Hao Chen , Qingguo Chen , Weihua Luo , Wei Dong , Qingsen Yan , Haokui Zhang , Chunhua Shen