English
Related papers

Related papers: PreFlect: From Retrospective to Prospective Reflec…

200 papers

Multi-turn interactions between large language models (LLMs) and users naturally include implicit feedback signals. If an LLM responds in an unexpected way to an instruction, the user is likely to signal it by rephrasing the request,…

Computation and Language · Computer Science 2025-05-22 Zizhao Chen , Mustafa Omer Gul , Yiwei Chen , Gloria Geng , Anne Wu , Yoav Artzi

Large Language Models (LLMs) are increasingly explored for legal argument generation, yet they pose significant risks of manipulation through hallucination and ungrounded persuasion, and often fail to utilize provided factual bases…

Artificial Intelligence · Computer Science 2025-10-27 Li Zhang , Kevin D. Ashley

When making significant life decisions, people increasingly turn to conversational AI tools, such as large language models (LLMs). However, LLMs often steer users toward solutions, limiting metacognitive awareness of their own…

Human-Computer Interaction · Computer Science 2025-10-07 Morita Tarvirdians , Senthil Chandrasegaran , Hayley Hung , Catholijn M. Jonker , Catharine Oertel

While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically…

Artificial Intelligence · Computer Science 2026-01-21 Xinmeng Hou , Peiliang Gong , Bohao Qu , Wuqi Wang , Qing Guo , Yang Liu

While large language model (LLM) agents have demonstrated impressive problem-solving capabilities, they typically operate as static systems, lacking the ability to evolve through lifelong interaction. Existing attempts to bridge this gap…

Machine Learning · Computer Science 2026-02-03 Hongzhuo Yu , Fei Zhu , Guo-Sen Xie , Ling Shao

Large language models (LLMs) have achieved strong performance on complex reasoning tasks using techniques such as chain-of-thought and self-consistency. However, ensemble-based approaches, especially self-consistency which relies on…

Artificial Intelligence · Computer Science 2025-12-23 Qinglin Zeng , Jing Yang , Keze Wang

The evolution of large language models (LLMs) has enhanced the planning capabilities of language agents in diverse real-world scenarios. Despite these advancements, the potential of LLM-powered agents to comprehend ambiguous user…

Computation and Language · Computer Science 2024-10-03 Xuan Zhang , Yang Deng , Zifeng Ren , See-Kiong Ng , Tat-Seng Chua

Pre-trained Vision-Language-Action (VLA) models represent a major leap towards general-purpose robots, yet efficiently adapting them to novel, specific tasks in-situ remains a significant hurdle. While reinforcement learning (RL) is a…

Robotics · Computer Science 2026-04-10 Baicheng Li , Dong Wu , Zike Yan , Xinchen Liu , Lusong Li , Zecui Zeng , Hongbin Zha

Solving complex long-horizon robotic manipulation problems requires sophisticated high-level planning capabilities, the ability to reason about the physical world, and reactively choose appropriate motor skills. Vision-language models…

Robotics · Computer Science 2025-02-25 Yunhai Feng , Jiaming Han , Zhuoran Yang , Xiangyu Yue , Sergey Levine , Jianlan Luo

Self-reflection enables language agents to iteratively refine solutions, yet often produces repetitive outputs that limit reasoning performance. Recent studies have attempted to address this limitation through various approaches, among…

Machine Learning · Computer Science 2026-03-02 Tianjun Yao , Yongqiang Chen , Yujia Zheng , Pan Li , Zhiqiang Shen , Kun Zhang

Large language models have recently demonstrated significant gains in reasoning ability, often attributed to their capacity to generate longer chains of thought and engage in reflective reasoning. However, the contribution of reflections to…

Artificial Intelligence · Computer Science 2025-10-10 Liwei Kang , Yue Deng , Yao Xiao , Zhanfeng Mo , Wee Sun Lee , Lidong Bing

LLM-based deep research agents are largely built on the ReAct framework. This linear design makes it difficult to revisit earlier states, branch into alternative search directions, or maintain global awareness under long contexts, often…

This survey explores the development of meta-thinking capabilities in Large Language Models (LLMs) from a Multi-Agent Reinforcement Learning (MARL) perspective. Meta-thinking self-reflection, assessment, and control of thinking processes is…

Artificial Intelligence · Computer Science 2025-04-22 Ahsan Bilal , Muhammad Ahmed Mohsin , Muhammad Umer , Muhammad Awais Khan Bangash , Muhammad Ali Jamshed

Large language models (LLMs) have significantly improved their reasoning and decision-making capabilities, as seen in methods like ReAct. However, despite its effectiveness in tackling complex tasks, ReAct faces two main challenges: losing…

Artificial Intelligence · Computer Science 2024-10-15 Shuoqiu Li , Han Xu , Haipeng Chen

Large language model agents rely on effective model context to obtain task-relevant information for decision-making. Many existing context engineering approaches primarily rely on the context generated from the past experience and retrieval…

Artificial Intelligence · Computer Science 2026-04-10 Linbo Liu , Guande Wu , Han Ding , Yawei Wang , Qiang Zhou , Yuzhe Lu , Zhichao Xu , Huan Song , Panpan Xu , Lin Lee Cheong

Multimodal Large Language Models (MLLMs) have shown great potential in revolutionizing Graphical User Interface (GUI) automation. However, existing GUI models mostly rely on learning from nearly error-free offline trajectories, thus lacking…

Artificial Intelligence · Computer Science 2025-06-10 Penghao Wu , Shengnan Ma , Bo Wang , Jiaheng Yu , Lewei Lu , Ziwei Liu

The reflection capacity of Large Language Model (LLM) has garnered extensive attention. A post-hoc prompting strategy, e.g., reflexion and self-refine, refines LLM's response based on self-evaluated or external feedback. However, recent…

Computation and Language · Computer Science 2024-06-10 Wenqi Zhang , Yongliang Shen , Linjuan Wu , Qiuying Peng , Jun Wang , Yueting Zhuang , Weiming Lu

Despite the rapid advancements in LLM agents, they still face the challenge of generating meaningful reflections due to inadequate error analysis and a reliance on rare successful trajectories, especially in complex tasks. In this work, we…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Monica Sunkara , Yi Zhang

Standard reinforcement learning (RL) for large language model (LLM) agents typically optimizes extrinsic rewards, prioritizing isolated task completion over continual adaptation. Consequently, agents often converge to suboptimal policies…

Artificial Intelligence · Computer Science 2026-03-31 Xiaoying Zhang , Zichen Liu , Yipeng Zhang , Xia Hu , Wenqi Shao

Recent studies suggest that self-reflective prompting can significantly enhance the reasoning capabilities of Large Language Models (LLMs). However, the use of external feedback as a stop criterion raises doubts about the true extent of…

Computation and Language · Computer Science 2024-04-16 Yanhong Li , Chenghao Yang , Allyson Ettinger