English
Related papers

Related papers: Contrastive Decoding Improves Reasoning in Large L…

200 papers

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Stochastic sampling strategies are widely adopted in large language models (LLMs) to balance output coherence and diversity. These heuristics are often inherited in Multimodal LLMs (MLLMs) without task-specific justification. However, we…

Computation and Language · Computer Science 2026-04-28 Boqi Chen , Xudong Liu , Yunke Ao , Jianing Qiu

This paper investigates an under-explored challenge in large language models (LLMs): chain-of-thought prompting with noisy rationales, which include irrelevant or inaccurate reasoning thoughts within examples used for in-context learning.…

Computation and Language · Computer Science 2024-11-01 Zhanke Zhou , Rong Tao , Jianing Zhu , Yiwen Luo , Zengmao Wang , Bo Han

Text generation is of great importance to many natural language processing applications. However, maximization-based decoding methods (e.g. beam search) of neural language models often lead to degenerate solutions -- the generated text is…

Computation and Language · Computer Science 2022-09-27 Yixuan Su , Tian Lan , Yan Wang , Dani Yogatama , Lingpeng Kong , Nigel Collier

Despite their impressive capabilities, large language models (LLMs) are prone to hallucinations, i.e., generating content that deviates from facts seen during pretraining. We propose a simple decoding strategy for reducing hallucinations…

Computation and Language · Computer Science 2024-03-12 Yung-Sung Chuang , Yujia Xie , Hongyin Luo , Yoon Kim , James Glass , Pengcheng He

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

Table-based reasoning has shown remarkable progress in combining deep models with discrete reasoning, which requires reasoning over both free-form natural language (NL) questions and structured tabular data. However, previous table-based…

Computation and Language · Computer Science 2023-04-28 Yunhu Ye , Binyuan Hui , Min Yang , Binhua Li , Fei Huang , Yongbin Li

Efficient inference in large language models (LLMs) has become a critical focus as their scale and complexity grow. Traditional autoregressive decoding, while effective, suffers from computational inefficiencies due to its sequential token…

Computation and Language · Computer Science 2024-11-28 Hyun Ryu , Eric Kim

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

Explicit chain-of-thought (CoT) reasoning substantially improves the reasoning ability of large language models (LLMs), but incurs high inference cost due to lengthy autoregressive traces. Existing latent reasoning methods offer a promising…

Computation and Language · Computer Science 2026-05-26 Hui Xie , Jie Liu , Ziyue Qiao , Joaquin Vanschore

Large language models (LLMs) have achieved notable success in code generation. However, they still frequently produce uncompilable output because their next-token inference procedure does not model formal aspects of code. Although…

Machine Learning · Computer Science 2025-05-09 Niels Mündler , Jingxuan He , Hao Wang , Koushik Sen , Dawn Song , Martin Vechev

Large Language Models (LLMs) have been shown to achieve impressive results for many reasoning-based NLP tasks, suggesting a degree of deductive reasoning capability. However, it remains unclear to which extent LLMs, in both informal and…

Computation and Language · Computer Science 2025-08-26 Fabian Hoppe , Filip Ilievski , Jan-Christoph Kalo

Chain-of-thought prompting combined with pre-trained large language models has achieved encouraging results on complex reasoning tasks. In this paper, we propose a new decoding strategy, self-consistency, to replace the naive greedy…

Computation and Language · Computer Science 2023-03-08 Xuezhi Wang , Jason Wei , Dale Schuurmans , Quoc Le , Ed Chi , Sharan Narang , Aakanksha Chowdhery , Denny Zhou

Fine-tuning large language models (LLMs) for recommendation in a generative manner has delivered promising results, but encounters significant inference overhead due to autoregressive decoding in the language space. This work explores…

Information Retrieval · Computer Science 2025-09-16 Chengbing Wang , Yang Zhang , Zhicheng Wang , Tianhao Shi , Keqin Bao , Fuli Feng , Tat-Seng Chua

This paper proposes a detailed prompting flow, termed Table-Logic, to investigate the performance contrasts between bigger and smaller language models (LMs) utilizing step-by-step reasoning methods in the TableQA task. The method processes…

Computation and Language · Computer Science 2024-11-26 Haoyan Yang , Yixuan Wang , Keyue Tong , Hongjin Zhu , Yuanxin Zhang

Large language models pick up social biases from the data they are trained on and carry those biases into downstream applications, often reinforcing stereotypes around gender, race, religion, disability, age, and socioeconomic status. The…

Computation and Language · Computer Science 2026-05-05 Muneeb Ur Raheem Khan

While large vision-language models (LVLMs) have shown impressive capabilities in generating plausible responses correlated with input visual contents, they still suffer from hallucinations, where the generated text inaccurately reflects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning…

Computation and Language · Computer Science 2023-06-06 John Wieting , Jonathan H. Clark , William W. Cohen , Graham Neubig , Taylor Berg-Kirkpatrick

Large language models (LLMs) have exhibited impressive capabilities across a myriad of tasks, yet they occasionally yield undesirable outputs. We posit that these limitations are rooted in the foundational autoregressive architecture of…

Computation and Language · Computer Science 2025-03-03 Cheng Yang , Chufan Shi , Siheng Li , Bo Shui , Yujiu Yang , Wai Lam

Today's most accurate language models are trained on orders of magnitude more language data than human language learners receive - but with no supervision from other sensory modalities that play a crucial role in human learning. Can we make…

Computation and Language · Computer Science 2024-03-22 Chengxu Zhuang , Evelina Fedorenko , Jacob Andreas