English
Related papers

Related papers: Mind the Gap: A Closer Look at Tokenization for Mu…

200 papers

Large language models (LLMs) have shown promising efficacy across various tasks, becoming powerful tools in numerous aspects of human life. However, Transformer-based LLMs suffer a performance degradation when modeling long-term contexts…

Computation and Language · Computer Science 2026-03-23 Weiyao Luo , Suncong Zheng , Heming Xia , Weikang Wang , Yan Lei , Tianyu Liu , Shuang Chen , Zhifang Sui

Instruction-tuned large language models produce helpful, structured responses, but how robust is this helpfulness under trivial constraints? We show that simple lexical constraints (banning a single punctuation character or common word)…

Computation and Language · Computer Science 2026-04-28 Erfan Baghaei Potraghloo , Seyedarmin Azizi , Souvik Kundu , Massoud Pedram

Large Language Models (LLMs) have recently been shown to produce estimates of psycholinguistic norms, such as valence, arousal, or concreteness, for words and multiword expressions, that correlate with human judgments. These estimates are…

Computation and Language · Computer Science 2026-03-13 Thomas Hikaru Clark , Carlos Arriaga , Javier Conde , Gonzalo Martínez , Pedro Reviriego

This research aims to unravel how large language models (LLMs) iteratively refine token predictions through internal processing. We utilized a logit lens technique to analyze the model's token predictions derived from intermediate…

Computation and Language · Computer Science 2025-06-10 Jaturong Kongmanee

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

Computation and Language · Computer Science 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

While large language models (LLMs) are equipped with longer text input capabilities than before, they are struggling to seek correct information in long contexts. The "lost in the middle" problem challenges most LLMs, referring to the…

Computation and Language · Computer Science 2024-08-15 Junqing He , Kunhao Pan , Xiaoqun Dong , Zhuoyang Song , Yibo Liu , Qianguo Sun , Yuxin Liang , Hao Wang , Enming Zhang , Jiaxing Zhang

While Large Language Models (LLMs) demonstrate impressive reasoning capabilities, growing evidence suggests much of their success stems from memorized answer-reasoning patterns rather than genuine inference. In this work, we investigate a…

Computation and Language · Computer Science 2025-06-24 Yang Wu , Yifan Zhang , Yiwei Wang , Yujun Cai , Yurong Wu , Yuran Wang , Ning Xu , Jian Cheng

This study examines how user-provided suggestions affect Large Language Models (LLMs) in a simulated educational context, where sycophancy poses significant risks. Testing five different LLMs from the OpenAI GPT-4o and GPT-4.1 model classes…

Computation and Language · Computer Science 2025-06-13 Chuck Arvin

For large language models (LLMs), post-training quantization (PTQ) can significantly reduce memory footprint and computational overhead. Model quantization is rapidly evolving. Though many papers report breakthrough results, they are often…

Machine Learning · Computer Science 2026-01-30 Yutong Liu , Cairong Zhao , Guosheng Hu

Large language models (LLMs) are increasingly adopted in medical question-answering (QA) scenarios. However, LLMs can generate hallucinations and nonfactual information, undermining their trustworthiness in high-stakes medical tasks.…

Computation and Language · Computer Science 2025-05-09 Yusong Ke , Hongru Lin , Yuting Ruan , Junya Tang , Li Li

Recent work shows that large language models (LLMs) can answer multiple-choice questions using only the choices, but does this mean that MCQA leaderboard rankings of LLMs are largely influenced by abilities in choices-only settings? To…

Computation and Language · Computer Science 2024-07-03 Nishant Balepur , Rachel Rudinger

Question answering on free-form tables (a.k.a. TableQA) is a challenging task because of the flexible structure and complex schema of tables. Recent studies use Large Language Models (LLMs) for this task, exploiting their capability in…

Computation and Language · Computer Science 2025-06-17 Yuxiang Wang , Jianzhong Qi , Junhao Gan

Tokenization is associated with many poorly understood shortcomings in language models (LMs), yet remains an important component for long sequence scaling purposes. This work studies how tokenization impacts model performance by analyzing…

Computation and Language · Computer Science 2025-04-15 Buu Phan , Brandon Amos , Itai Gat , Marton Havasi , Matthew Muckley , Karen Ullrich

Generative recommendation systems, driven by large language models (LLMs), present an innovative approach to predicting user preferences by modeling items as token sequences and generating recommendations in a generative manner. A critical…

Abstention Ability (AA) is a critical aspect of Large Language Model (LLM) reliability, referring to an LLM's capability to withhold responses when uncertain or lacking a definitive answer, without compromising performance. Although…

Computation and Language · Computer Science 2024-09-25 Nishanth Madhusudhan , Sathwik Tejaswi Madhusudhan , Vikas Yadav , Masoud Hashemi

Understanding the decision-making processes of large language models (LLMs) is essential for their trustworthy development and deployment. However, current interpretability methods often face challenges such as low resolution and high…

Computation and Language · Computer Science 2025-10-14 Tian Lan , Jinyuan Xu , Xue He , Jenq-Neng Hwang , Lei Li

Language models typically tokenize raw text into sequences of subword identifiers from a predefined vocabulary, a process inherently sensitive to typographical errors, length variations, and largely oblivious to the internal structure of…

Computation and Language · Computer Science 2024-10-07 Yekun Chai , Yewei Fang , Qiwei Peng , Xuhong Li

Hallucination in large language models (LLMs) can be detected by assessing the uncertainty of model outputs, typically measured using entropy. Semantic entropy (SE) enhances traditional entropy estimation by quantifying uncertainty at the…

Machine Learning · Computer Science 2025-06-03 Dang Nguyen , Ali Payani , Baharan Mirzasoleiman

A central challenge in developing Multimodal Large Language Models (MLLMs) is effectively integrating heterogeneous inputs into a cohesive reasoning engine. Current paradigms predominantly rely on modular architectures that introduce…

Genomics · Quantitative Biology 2026-05-12 Yanan Li , Christina Yi Jin , Yuan Jin , Manli Luo , Tie Xu , Shuai Jiao , Wei He , Qing Zhang

A distinction is often drawn between a model's ability to predict a label for an evaluation sample that is directly memorised from highly similar training samples versus an ability to predict the label via some method of generalisation. In…

Computation and Language · Computer Science 2023-11-22 Tim Hartill , Joshua Bensemann , Michael Witbrock , Patricia J. Riddle