English
Related papers

Related papers: Internalizing Agency from Reflective Experience

200 papers

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

In practice, reinforcement learning (RL) agents are often trained with a possibly imperfect proxy reward function, which may lead to a human-agent alignment issue (i.e., the learned policy either converges to non-optimal performance with…

Machine Learning · Computer Science 2024-10-10 Zhaohui Jiang , Xuening Feng , Paul Weng , Yifei Zhu , Yan Song , Tianze Zhou , Yujing Hu , Tangjie Lv , Changjie Fan

Despite the rapid progress that existing automated feedback methods have made in correcting the output of large language models (LLMs), these methods cannot be well applied to the relation extraction (RE) task due to their designated…

Computation and Language · Computer Science 2024-12-12 Yongqi Li , Xin Miao , Shen Zhou , Mayi Xu , Yuyang Ren , Tieyun Qian

The personalization of black-box large language models (LLMs) is a critical yet challenging task. Existing approaches predominantly rely on context injection, where user history is embedded into the prompt to directly guide the generation…

Computation and Language · Computer Science 2025-11-10 Teqi Hao , Xioayu Tan , Shaojie Shi , Yinghui Xu , Xihe Qiu

A central piece in enabling intelligent agentic behavior in foundation models is to make them capable of introspecting upon their behavior, reasoning, and correcting their mistakes as more computation or interaction is available. Even the…

Machine Learning · Computer Science 2024-07-29 Yuxiao Qu , Tianjun Zhang , Naman Garg , Aviral Kumar

In recent research advancements within the community, large language models (LLMs) have sparked great interest in creating autonomous agents. However, current prompt-based agents often heavily rely on large-scale LLMs. Meanwhile, although…

Computation and Language · Computer Science 2025-03-04 Xueyang Feng , Bo Lan , Quanyu Dai , Lei Wang , Jiakai Tang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students…

Physics Education · Physics 2024-12-31 Steffen Steinert , Karina E. Avila , Stefan Ruzika , Jochen Kuhn , Stefan Küchemann

Agentic Reinforcement Learning (Agentic RL) has achieved notable success in enabling agents to perform complex reasoning and tool use. However, most methods still relies on sparse outcome-based reward for training. Such feedback fails to…

Artificial Intelligence · Computer Science 2026-04-29 Kaixuan Fan , Kaituo Feng , Manyuan Zhang , Tianshuo Peng , Zhixun Li , Yilei Jiang , Shuang Chen , Peng Pei , Xunliang Cai , Xiangyu Yue

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify…

Neural and Evolutionary Computing · Computer Science 2025-05-26 Rishi Hazra , Alkis Sygkounas , Andreas Persson , Amy Loutfi , Pedro Zuidberg Dos Martires

Training large language models (LLMs) as autonomous agents often begins with imitation learning, but it only teaches agents what to do without understanding why: agents never contrast successful actions against suboptimal alternatives and…

Artificial Intelligence · Computer Science 2026-03-10 Weize Liu , Minghui Liu , Sy-Tuyen Ho , Souradip Chakraborty , Xiyao Wang , Furong Huang

The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Sarah Pratt , Luca Weihs , Ali Farhadi

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly,…

Computation and Language · Computer Science 2026-05-06 Jackson Hassell , Dan Zhang , Hannah Kim , Tom Mitchell , Estevam Hruschka

Large Language Models (LLMs) as agents often struggle in out-of-distribution (OOD) scenarios. Real-world environments are complex and dynamic, governed by task-specific rules and stochasticity, which makes it difficult for LLMs to ground…

Machine Learning · Computer Science 2025-10-20 Shiqi Chen , Tongyao Zhu , Zian Wang , Jinghan Zhang , Kangrui Wang , Siyang Gao , Teng Xiao , Yee Whye Teh , Junxian He , Manling Li

Large language model (LLM) agents achieve impressive single-task performance but commonly exhibit repeated failures, inefficient exploration, and limited cross-task adaptability. Existing reflective strategies (e.g., Reflexion, ReAct)…

Artificial Intelligence · Computer Science 2025-09-09 Chunlong Wu , Ye Luo , Zhibo Qu , Min Wang

Large language model agents often fail to accumulate knowledge from experience, treating each task as an independent challenge. Recent methods extract experience as flattened textual knowledge, which cannot capture procedural logic of…

Artificial Intelligence · Computer Science 2026-02-02 Libin Qiu , Zhirong Gao , Junfu Chen , Yuhang Ye , Weizhi Huang , Xiaobo Xue , Wenkai Qiu , Shuo Tang

Large Language Models (LLMs) can generate code from natural language, but their performance is highly sensitive to prompt formulation. We propose a reinforcement-learning-based framework that models prompt refinement as a sequential…

Software Engineering · Computer Science 2026-05-20 Ali Mohammadi Esfahani , Nafiseh Kahani , Samuel A. Ajila

Training large language model (LLM) agents to acquire necessary skills and perform diverse tasks within an environment is gaining interest as a means to enable open-endedness. However, creating the training dataset for their skill…

Artificial Intelligence · Computer Science 2025-06-23 Yongjin Yang , Sinjae Kang , Juyong Lee , Dongjun Lee , Se-Young Yun , Kimin Lee

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah