English
Related papers

Related papers: Drift No More? Context Equilibria in Multi-Turn LL…

200 papers

How does the natural evolution of context paragraphs affect question answering in generative Large Language Models (LLMs)? To investigate this, we propose a framework for curating naturally evolved, human-edited variants of reading passages…

Computation and Language · Computer Science 2025-09-03 Yulong Wu , Viktor Schlegel , Riza Batista-Navarro

Instruction tuning is a widely used approach to improve the instruction-following ability of large language models (LLMs). Instruction-tuning datasets typically include a mixture of context-augmented and context-free examples, yet prior…

Computation and Language · Computer Science 2026-01-09 Hyunji Lee , Seunghyun Yoon , Yunjae Won , Hanseok Oh , Geewook Kim , Trung Bui , Franck Dernoncourt , Elias Stengel-Eskin , Mohit Bansal , Minjoon Seo

Multi-Agent Discussion (MAD) has garnered increasing attention very recently, where multiple LLM instances collaboratively solve problems via structured discussion. However, we find that current MAD methods easily suffer from discussion…

Artificial Intelligence · Computer Science 2026-05-14 Xingyuan Hua , Sheng Yue , Xinyi Li , Yizhe Zhao , Jinrui Zhang , Ju Ren

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

Modern LLM based agents are no longer passive text generators. They read repositories, call tools, browse the web, execute code, maintain memory, communicate with other agents, and act through long horizon workflows. This shift moves the…

Multiagent Systems · Computer Science 2026-05-12 Tianxiao Li , Yixing Ma , Haiquan Wen , Zhenglin Huang , Qianyu Zhou , Zeyu Fu , Guangliang Cheng

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Natural language as a medium for human-computer interaction has long been anticipated, has been undergoing a sea-change with the advent of Large Language Models (LLMs) with startling capacities for processing and generating language. Many…

Computation and Language · Computer Science 2025-03-25 Riya Naik , Ashwin Srinivasan , Estrid He , Swati Agarwal

Multi-turn conversation has emerged as a predominant interaction paradigm for Large Language Models (LLMs). Users often employ follow-up questions to refine their intent, expecting LLMs to adapt dynamically. However, recent research reveals…

Computation and Language · Computer Science 2026-02-10 Geng Liu , Fei Zhu , Rong Feng , Changyi Ma , Shiqi Wang , Gaofeng Meng

Most machine learning models are static, but the world is dynamic, and increasing online deployment of learned models gives increasing urgency to the development of efficient and effective mechanisms to address learning in the context of…

Machine Learning · Computer Science 2016-11-16 Geoffrey I. Webb , Roy Hyde , Hong Cao , Hai Long Nguyen , Francois Petitjean

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

Human-Computer Interaction · Computer Science 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Standard evaluation practices assume that large language model (LLM) outputs are stable under contextually equivalent formulations of a task. Here, we test this assumption in the setting of gender inference. Using a controlled pronoun…

Computation and Language · Computer Science 2026-03-25 Sagar Kumar , Ariel Flint , Luca Maria Aiello , Andrea Baronchelli

Scaling large language models (LLMs) leads to an emergent capacity to learn in-context from example demonstrations. Despite progress, theoretical understanding of this phenomenon remains limited. We argue that in-context learning relies on…

Computation and Language · Computer Science 2023-03-15 Michael Hahn , Navin Goyal

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Effective conversational search demands a deep understanding of user intent across multiple dialogue turns. Users frequently use abbreviations and shift topics in the middle of conversations, posing challenges for conventional retrievers.…

Information Retrieval · Computer Science 2025-09-25 Seunghan Yang , Juntae Lee , Jihwan Bang , Kyuhong Shim , Minsoo Kim , Simyung Chang

Multi-agent debate - multiple instances of large language models discussing problems in turn-based interaction - has shown promise for solving knowledge and reasoning tasks. However, these methods show limitations when solving complex…

Computation and Language · Computer Science 2026-04-10 Jonas Becker , Lars Benedikt Kaesberg , Andreas Stephan , Jan Philip Wahle , Terry Ruas , Bela Gipp

Large language models (LLMs) trained on huge corpora of text datasets demonstrate intriguing capabilities, achieving state-of-the-art performance on tasks they were not explicitly trained for. The precise nature of LLM capabilities is often…

Artificial Intelligence · Computer Science 2024-04-17 Eric J. Bigelow , Ekdeep Singh Lubana , Robert P. Dick , Hidenori Tanaka , Tomer D. Ullman

Extended interaction with large language models (LLMs) has been linked to the reinforcement of delusional beliefs, a phenomenon attracting growing clinical and public concern. Yet most empirical work evaluates model safety in brief…

Human-Computer Interaction · Computer Science 2026-04-24 Luke Nicholls , Robert Hutto , Zephrah Soto , Hamilton Morrin , Thomas Pollak , Raj Korpan , Cheryl Carmichael

Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding and adaptation.…

Machine Learning · Computer Science 2020-04-14 Jie Lu , Anjin Liu , Fan Dong , Feng Gu , Joao Gama , Guangquan Zhang

Large Language Model (LLM) interactions are typically underspecified, with users clarifying all necessary details across multiple conversational turns. Yet recent work shows that LLMs perform far worse in this multi-turn setting than in a…

Computation and Language · Computer Science 2026-05-26 Tianlang Chen , Shirley Wu , Jure Leskovec

Large Language Models (LLMs) often struggle to maintain their original performance when faced with semantically coherent but task-irrelevant contextual information. Although prior studies have explored this issue using fixed-template or…

Computation and Language · Computer Science 2025-09-23 Yanbo Wang , Zixiang Xu , Yue Huang , Chujie Gao , Siyuan Wu , Jiayi Ye , Pin-Yu Chen , Xiuying Chen , Xiangliang Zhang