English
Related papers

Related papers: LayerCake: Token-Aware Contrastive Decoding within…

200 papers

Decoding methods play an indispensable role in converting language models from next-token predictors into practical task solvers. Prior research on decoding methods, primarily focusing on task-specific models, may not extend to the current…

Computation and Language · Computer Science 2024-10-10 Chufan Shi , Haoran Yang , Deng Cai , Zhisong Zhang , Yifan Wang , Yujiu Yang , Wai Lam

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on NLP tasks, but their black-box nature, which leads to a lack of interpretability, has been a major concern. My…

Computation and Language · Computer Science 2024-12-06 Ximing Wen

Today's most accurate language models are trained on orders of magnitude more language data than human language learners receive - but with no supervision from other sensory modalities that play a crucial role in human learning. Can we make…

Computation and Language · Computer Science 2024-03-22 Chengxu Zhuang , Evelina Fedorenko , Jacob Andreas

Large reasoning models (LRMs) achieve strong reasoning performance by emitting long chains of thought. Yet, these verbose traces slow down inference and often drift into unnecessary detail, known as the overthinking phenomenon. To better…

Computation and Language · Computer Science 2025-06-10 Ming Li , Zhengyuan Yang , Xiyao Wang , Dianqi Li , Kevin Lin , Tianyi Zhou , Lijuan Wang

Large Language Models (LLMs) have demonstrated strong performance in question answering (QA) tasks. However, Multi-Answer Question Answering (MAQA), where a question may have several valid answers, remains challenging. Traditional QA…

Computation and Language · Computer Science 2025-08-19 Eviatar Nachshoni , Arie Cattan , Shmuel Amar , Ori Shapira , Ido Dagan

Multimodal large language models have experienced rapid growth, and numerous different models have emerged. The interpretability of LVLMs remains an under-explored area. Especially when faced with more complex tasks such as chain-of-thought…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Xiaofeng Zhang , Fanshuo Zeng , Yihao Quan , Zheng Hui , Jiawei Yao

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

Computation and Language · Computer Science 2025-08-05 Yijun Feng

The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous successful applications, the underlying mechanism of such…

Computation and Language · Computer Science 2023-06-09 Xiaojuan Tang , Zilong Zheng , Jiaqi Li , Fanxu Meng , Song-Chun Zhu , Yitao Liang , Muhan Zhang

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide array of text-centric tasks. However, their `large' scale introduces significant computational and storage challenges, particularly in…

Computation and Language · Computer Science 2024-07-03 Chaoran Zhang , Lixin Zou , Dan Luo , Min Tang , Xiangyang Luo , Zihao Li , Chenliang Li

Large language models (LLMs), trained on large-scale text, have recently attracted significant attention for their strong performance across many tasks. Motivated by this, we investigate whether a text-trained LLM can help localize fake…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-13 Lin Zhang , Thomas Thebaud , Zexin Cai , Sanjeev Khudanpur , Daniel Povey , Leibny Paola García-Perera , Matthew Wiesner , Nicholas Andrews

Large language models (LLMs) often generate self-contradictory outputs, which severely impacts their reliability and hinders their adoption in practical applications. In video-language models (Video-LLMs), this phenomenon recently draws the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Chengzhi Li , Heyan Huang , Ping Jian , Zhen Yang , Yaning Tian , Zhongbin Guo

The prefill stage in long-context LLM inference remains a computational bottleneck. Recent token-ranking heuristics accelerate inference by selectively processing a subset of semantically relevant tokens. However, existing methods suffer…

Computation and Language · Computer Science 2026-02-19 Bradley McDanel , Steven Li , Harshit Khaitan

Representing continuous time is a critical and under-explored challenge in modeling temporal event sequences with large language models (LLMs). Various strategies like byte-level representations or calendar tokens have been proposed.…

Computation and Language · Computer Science 2026-05-12 Zefang Liu , Nam H. Nguyen , Yinzhu Quan , Shi-Xiong Zhang

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

Computation and Language · Computer Science 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Parallel decoding methods such as Jacobi decoding show promise for more efficient LLM inference as it breaks the sequential nature of the LLM decoding process and transforms it into parallelizable computation. However, in practice, it…

Computation and Language · Computer Science 2024-06-14 Siqi Kou , Lanxiang Hu , Zhezhi He , Zhijie Deng , Hao Zhang

Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects. It is reported that these models tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Li , Dehong Gao , Yeyuan Wang , Linbo Jin , Shanqing Yu , Xiaoyan Cai , Libin Yang

Large Language Models (LLMs) often produce fluent yet factually incorrect statements-a phenomenon known as hallucination-posing serious risks in high-stakes domains. We present Layer-wise Semantic Dynamics (LSD), a geometric framework for…

Computation and Language · Computer Science 2025-10-07 Amir Hameed Mir

Large Multimodal Models (LMMs) such as LLaVA are typically trained with an autoregressive language modeling objective, providing only indirect supervision to visual tokens. This often yields weak internal visual representations and brittle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Dhruv Parikh , Jacob Fein-Ashley , Rajgopal Kannan , Viktor Prasanna