English
Related papers

Related papers: LLMs are Not Just Next Token Predictors

200 papers

Large Language Models (LLMs) are widely deployed in real-world applications, yet little is known about their training dynamics at the token level. Evaluation typically relies on aggregated training loss, measured at the batch level, which…

Computation and Language · Computer Science 2024-10-17 Andrea Pinto , Tomer Galanti , Randall Balestriero

The next-token prediction (NTP) objective has been foundational in the development of modern large language models (LLMs), driving advances in fluency and generalization. However, NTP operates at the \textit{token} level, treating…

Computation and Language · Computer Science 2026-01-23 Laya Iyer , Pranav Somani , Alice Guo , Dan Jurafsky , Chen Shani

We propose a novel class of language models, Latent Thought Models (LTMs), which incorporate explicit latent thought vectors that follow an explicit prior model in latent space. These latent thought vectors guide the autoregressive…

Computation and Language · Computer Science 2025-06-10 Deqian Kong , Minglu Zhao , Dehong Xu , Bo Pang , Shu Wang , Edouardo Honig , Zhangzhang Si , Chuan Li , Jianwen Xie , Sirui Xie , Ying Nian Wu

Masked language models (MLM) do not explicitly define a distribution over language, i.e., they are not language models per se. However, recent work has implicitly treated them as such for the purposes of generation and scoring. This paper…

Computation and Language · Computer Science 2023-05-26 Lucas Torroba Hennigen , Yoon Kim

Large language models (LLMs) are increasingly used in situations where human values are at stake, such as decision-making tasks that involve reasoning when performed by humans. We investigate the so-called reasoning capabilities of LLMs…

Computation and Language · Computer Science 2025-12-25 Nathaniël de Leeuw , Marceau Nahon , Mathis Reymond , Raja Chatila , Mehdi Khamassi

Large Language Models (LLMs) are trained with next-token prediction, implemented in autoregressive Transformers via causal masking for parallelism. This creates a subtle misalignment: residual connections tie activations to the current…

Computation and Language · Computer Science 2026-03-03 Jonathan Lys , Vincent Gripon , Bastien Pasdeloup , Axel Marmoret , Lukas Mauch , Fabien Cardinaux , Ghouthi Boukli Hacene

Predicting the locations an individual will visit in the future is crucial for solving many societal issues like disease diffusion and reduction of pollution. However, next-location predictors require a significant amount of…

Computers and Society · Computer Science 2024-08-26 Ciro Beneduce , Bruno Lepri , Massimiliano Luca

Masked language modeling (MLM) is a widely used self-supervised pretraining objective, where a model needs to predict an original token that is replaced with a mask given contexts. Although simpler and computationally efficient pretraining…

Computation and Language · Computer Science 2023-05-19 Atsuki Yamaguchi , Hiroaki Ozaki , Terufumi Morishita , Gaku Morio , Yasuhiro Sogawa

This paper introduces distribution-based prediction, a novel approach to using Large Language Models (LLMs) as predictive tools by interpreting output token probabilities as distributions representing the models' learned representation of…

Artificial Intelligence · Computer Science 2024-11-07 Caleb Bradshaw , Caelen Miller , Sean Warnick

In response to the demand for Explainable Artificial Intelligence (XAI), we investigate the use of Large Language Models (LLMs) to transform ML explanations into natural, human-readable narratives. Rather than directly explaining ML models…

Artificial Intelligence · Computer Science 2024-05-13 Alexandra Zytek , Sara Pidò , Kalyan Veeramachaneni

We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the…

Computation and Language · Computer Science 2024-08-28 Shannon Zejiang Shen , Hunter Lang , Bailin Wang , Yoon Kim , David Sontag

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Computation and Language · Computer Science 2024-08-08 Shachi H Kumar , Saurav Sahay , Sahisnu Mazumder , Eda Okur , Ramesh Manuvinakurike , Nicole Beckage , Hsuan Su , Hung-yi Lee , Lama Nachman

Large Language Models (LLMs) are conversational interfaces. As such, LLMs have the potential to assist their users not only when they can fully specify the task at hand, but also to help them define, explore, and refine what they need…

Computation and Language · Computer Science 2025-05-12 Philippe Laban , Hiroaki Hayashi , Yingbo Zhou , Jennifer Neville

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

Machine Learning · Computer Science 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

What role can the otherwise successful Large Language Models (LLMs) play in the understanding of human cognition, and in particular in terms of informing language acquisition debates? To contribute to this question, we first argue that…

Computation and Language · Computer Science 2024-08-22 Emmanuel Chemla , Ryan M. Nefdt

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Large language models (LLMs) have revolutionized many areas (e.g. natural language processing, software engineering, etc.) by achieving state-of-the-art performance on extensive downstream tasks. Aiming to achieve robust and general…

Artificial Intelligence · Computer Science 2024-01-18 Zhiming Li , Yushi Cao , Xiufeng Xu , Junzhe Jiang , Xu Liu , Yon Shin Teo , Shang-wei Lin , Yang Liu

Although natural language is the default medium for Large Language Models (LLMs), its limited expressive capacity creates a profound bottleneck for complex problem-solving. While recent advancements in AI have relied heavily on scaling,…

Artificial Intelligence · Computer Science 2026-05-13 Zhiqin Yang , Yuhan Liu , Jingwen Fu , Pei Fu , Bo Han , Masashi Sugiyama , Nanning Zheng

Large language models (LLMs) are currently at the forefront of intertwining artificial intelligence (AI) systems with human communication and everyday life. Thus, aligning them with human values is of great importance. However, given the…

Computation and Language · Computer Science 2024-06-06 Thilo Hagendorff

Sequential Recommendation (SR) task involves predicting the next item a user is likely to interact with, given their past interactions. The SR models examine the sequence of a user's actions to discern more complex behavioral patterns and…

Information Retrieval · Computer Science 2025-04-22 Wujiang Xu , Qitian Wu , Zujie Liang , Jiaojiao Han , Xuying Ning , Yunxiao Shi , Wenfang Lin , Yongfeng Zhang