English
Related papers

Related papers: Generalization or Memorization: Dynamic Decoding f…

200 papers

Steering, or direct manipulation of internal activations to guide LLM responses toward specific semantic concepts, is emerging as a promising avenue for both understanding how semantic concepts are stored within LLMs and advancing LLM…

Machine Learning · Computer Science 2026-02-03 Parmida Davarmanesh , Ashia Wilson , Adityanarayanan Radhakrishnan

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

Large Language Models (LLMs) display strikingly different generalization behaviors: supervised fine-tuning (SFT) often narrows capability, whereas reinforcement-learning (RL) tuning tends to preserve it. The reasons behind this divergence…

Machine Learning · Computer Science 2026-01-01 Haoyue Bai , Yiyou Sun , Wenjie Hu , Shi Qiu , Maggie Ziyu Huan , Peiyang Song , Robert Nowak , Dawn Song

An essential part of monitoring machine learning models in production is measuring input and output data drift. In this paper, we present a system for measuring distributional shifts in natural language data and highlight and investigate…

Computation and Language · Computer Science 2023-12-06 Gyandev Gupta , Bashir Rastegarpanah , Amalendu Iyer , Joshua Rubin , Krishnaram Kenthapadi

We study how large language models (LLMs) reason about memorized knowledge through simple binary relations such as equality ($=$), inequality ($<$), and inclusion ($\subset$). Unlike in-context reasoning, the axioms (e.g., $a < b, b < c$)…

Machine Learning · Computer Science 2025-09-18 Jonathan Shaki , Emanuele La Malfa , Michael Wooldridge , Sarit Kraus

Vision-language models (VLMs) have exhibited remarkable generalization capabilities, and prompt learning for VLMs has attracted great attention for the ability to adapt pre-trained VLMs to specific downstream tasks. However, existing…

Machine Learning · Computer Science 2025-01-15 Song-Lin Lv , Yu-Yang Chen , Zhi Zhou , Ming Yang , Lan-Zhe Guo

Large Language Models (LLMs) and strong vision models have enabled rapid research and development in the field of Vision-Language-Action models that enable robotic control. The main objective of these methods is to develop a generalist…

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Recent advances in Large Language Models (LLMs) have intensified the debate surrounding the fundamental nature of their reasoning capabilities. While achieving high performance on benchmarks such as GPQA and MMLU, these models exhibit…

Artificial Intelligence · Computer Science 2025-01-24 Santosh Kumar Radha , Oktay Goktas

Large Language Models (LLMs) exhibit remarkable capabilities, yet it remains unclear to what extent these reflect sophisticated recall or genuine reasoning ability. We introduce chess as a controlled testbed aimed at disentangling these…

Computation and Language · Computer Science 2026-05-20 Leonard S. Pleiss , Maximilian Schiffer , Robert K. von Weizsaecker

Data-driven soft sensors (DDSS) have become mainstream methods for predicting key performance indicators in process industries. However, DDSS development requires complex and costly customized designs tailored to various tasks during the…

Artificial Intelligence · Computer Science 2025-01-10 Shuo Tong , Han Liu , Runyuan Guo , Xueqiong Tian , Wenqing Wang , Ding Liu , Youmin Zhang

We propose a method that enables large language models (LLMs) to control embodied agents through the generation of control policies that directly map continuous observation vectors to continuous action vectors. At the outset, the LLMs…

Artificial Intelligence · Computer Science 2026-02-25 Jônata Tyska Carvalho , Stefano Nolfi

The training and inference of large language models (LLMs) are together a costly process that transports knowledge from raw data to meaningful computation. Inspired by the memory hierarchy of the human brain, we reduce this cost by…

Computation and Language · Computer Science 2025-01-29 Hongkang Yang , Zehao Lin , Wenjin Wang , Hao Wu , Zhiyu Li , Bo Tang , Wenqiang Wei , Jinbo Wang , Zeyun Tang , Shichao Song , Chenyang Xi , Yu Yu , Kai Chen , Feiyu Xiong , Linpeng Tang , Weinan E

Despite the remarkable success of Multimodal Large Language Models (MLLMs) across diverse tasks, the internal mechanisms governing how they encode and ground distinct visual concepts remain poorly understood. To bridge this gap, we propose…

Artificial Intelligence · Computer Science 2026-05-08 Zehao Deng , Tianjie Ju , Zheng Wu , Liangbo He , Jun Lan , Huijia Zhu , Weiqiang Wang , Zhuosheng Zhang

Diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive (AR) LLMs. Recently, this paradigm has been extended to multimodal tasks, leading to the development of diffusion multimodal large language…

Artificial Intelligence · Computer Science 2026-04-08 Keuntae Kim , Mingyu Kang , Yong Suk Choi

Large language models (LLMs) have shown great capabilities in various tasks but also exhibited memorization of training data, raising tremendous privacy and copyright concerns. While prior works have studied memorization during…

Artificial Intelligence · Computer Science 2024-02-26 Shenglai Zeng , Yaxin Li , Jie Ren , Yiding Liu , Han Xu , Pengfei He , Yue Xing , Shuaiqiang Wang , Jiliang Tang , Dawei Yin

Vision Language Models (VLMs) are designed to extend Large Language Models (LLMs) with visual capabilities, yet in this work we observe a surprising phenomenon: VLMs can outperform their underlying LLMs on purely text-only tasks,…

Machine Learning · Computer Science 2026-02-18 Nicolas Buzeta , Felipe del Rio , Cristian Hinostroza , Denis Parra , Hans Lobel , Rodrigo Toro Icarte

We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the…

Computation and Language · Computer Science 2024-08-28 Shannon Zejiang Shen , Hunter Lang , Bailin Wang , Yoon Kim , David Sontag

Instruction-tuned large language models (LLMs) have shown strong performance on a variety of tasks; however, generalizing from synthetic to human-authored instructions in grounded environments remains a challenge for them. In this work, we…

Computation and Language · Computer Science 2025-08-19 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu