English
Related papers

Related papers: Honest Lying: Understanding Memory Confabulation i…

200 papers

Agents trained in simulation may make errors in the real world due to mismatches between training and execution environments. These mistakes can be dangerous and difficult to discover because the agent cannot predict them a priori. We…

Machine Learning · Computer Science 2018-05-24 Ramya Ramakrishnan , Ece Kamar , Debadeepta Dey , Julie Shah , Eric Horvitz

We present a theoretical study of continual and experiential learning in large language model agents that combine episodic memory with reinforcement learning. We argue that the key mechanism for continual adaptation, without updating model…

Artificial Intelligence · Computer Science 2026-01-30 Jun Wang

Large Language Model (LLM)-based agents are increasingly used as autonomous subordinates that carry out tasks for users. This raises the question of whether they may also engage in deception, similar to how individuals in human…

Large Language Models (LLMs) often produce explicit reflective traces during complex reasoning, accompanied by anthropomorphic markers such as wait, hmm, and alternatively. Although these markers are commonly used as visible indicators of…

Computation and Language · Computer Science 2026-05-28 Yahan Yu , Noa Nakanishi , Fei Cheng

Agentic Reinforcement Learning (Agentic RL) has achieved notable success in enabling agents to perform complex reasoning and tool use. However, most methods still relies on sparse outcome-based reward for training. Such feedback fails to…

Artificial Intelligence · Computer Science 2026-04-29 Kaixuan Fan , Kaituo Feng , Manyuan Zhang , Tianshuo Peng , Zhixun Li , Yilei Jiang , Shuang Chen , Peng Pei , Xunliang Cai , Xiangyu Yue

In this study, we investigated the effects of self-reflection in large language models (LLMs) on problem-solving performance. We instructed nine popular LLMs to answer a series of multiple-choice questions to provide a performance baseline.…

Computation and Language · Computer Science 2025-03-17 Matthew Renze , Erhan Guven

Hallucination occurs when large language models exhibit behavior that deviates from the boundaries of their knowledge during response generation. To address this critical issue, previous learning-based methods attempt to finetune models but…

Computation and Language · Computer Science 2025-05-27 Xueru Wen , Jie Lou , Xinyu Lu , Ji Yuqiu , Xinyan Guan , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Debing Zhang , Le Sun

The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough to power reasonably good Language agents, the closed-API…

Computation and Language · Computer Science 2024-10-11 Priyanshu Gupta , Shashank Kirtania , Ananya Singha , Sumit Gulwani , Arjun Radhakrishna , Sherry Shi , Gustavo Soares

Large language model (LLM) agents often rely on external demonstrations or retrieval-augmented planning, leading to brittleness, poor generalization, and high computational overhead. Inspired by human problem-solving, we propose DuSAR…

Artificial Intelligence · Computer Science 2026-02-03 Wentao Zhang , Qunbo Wang , BoXuan Zhao , Tao Zhang , Junsheng Wu , Hongping Gan , Ling Dai , Shizhuang Deng , Shuntong Sun , Yang Liu

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Reinforcement learning can train LLM agents from sparse task rewards, but long-horizon credit assignment remains challenging: a single success-or-failure signal must be distributed across many actions. Existing methods rely on…

Artificial Intelligence · Computer Science 2026-05-20 Xiaozhe Li , Tianyi Lyu , Yang Li , Yichuan Ma , Peiji Li , Linyang Li , Qipeng Guo , Dahua Lin , Kai Chen

Embodied LLMs endow robots with high-level task reasoning, but they cannot reflect on what went wrong or why, turning deployment into a sequence of independent trials where mistakes repeat rather than accumulate into experience. Drawing…

Machine Learning · Computer Science 2026-05-26 Yining Hong , Huang Huang , Manling Li , Li Fei-Fei , Leonidas Guibas , Jiajun Wu , Yejin Choi

Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of important information that is not presently available. Recently,…

Recent progress in multimodal foundation models has enabled Vision-Language Agents (VLAs) to decompose complex visual tasks into executable tool-based plans. While recent benchmarks have begun to evaluate iterative self-correction, its…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Aradhya Dixit

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

The ability to detect and analyze failed executions automatically is crucial for an explainable and robust robotic system. Recently, Large Language Models (LLMs) have demonstrated strong reasoning abilities on textual inputs. To leverage…

Robotics · Computer Science 2023-10-18 Zeyi Liu , Arpit Bahety , Shuran Song

Large Language Models (LLMs) have achieved remarkable advancements in reasoning capabilities empowered by Reinforcement Learning with Verifiable Rewards (RLVR). Nonetheless, RLVR intrinsically relies on ground-truth labels for reward…

Machine Learning · Computer Science 2026-05-26 Li Wang , Xiaodong Lu , Xiaohan Wang , Yikun Ban , Jiajun Chai , Wei Lin , Tianhao Peng , Guojun Yin

Existing prompt-optimization techniques rely on local signals to update behavior, often neglecting broader and recurring patterns across tasks, leading to poor generalization; they further rely on full-prompt rewrites or unstructured…

Software Engineering · Computer Science 2026-03-24 Balaji Dinesh Gangireddi , Aniketh Garikaparthi , Manasi Patwardhan , Arman Cohan

We study emergent social dynamics in LLM agents playing The Resistance: Avalon, a hidden-role deception game. Unlike prior work on single-game performance, our agents play repeated games while retaining memory of previous interactions,…

Multiagent Systems · Computer Science 2026-04-23 Suveen Ellawela

The aim of inverse reinforcement learning (IRL) is to infer an agent's preferences from observing their behaviour. Usually, preferences are modelled as a reward function, $R$, and behaviour is modelled as a policy, $\pi$. One of the central…

Machine Learning · Computer Science 2024-12-17 Joar Skalse , Alessandro Abate