English
Related papers

Related papers: Reinforcing Language Agents via Policy Optimizatio…

200 papers

Alignment of Large Language models (LLMs) is crucial for safe and trustworthy deployment in applications. Reinforcement learning from human feedback (RLHF) has emerged as an effective technique to align LLMs to human preferences and broader…

Large reasoning models have achieved remarkable performance through extended chain-of-thought sequences, yet this computational freedom leads to excessive token generation even for simple problems. We present Length-Adaptive Policy…

Artificial Intelligence · Computer Science 2025-08-15 Xingyu Wu , Yuchen Yan , Shangke Lyu , Linjuan Wu , Yiwen Qiu , Yongliang Shen , Weiming Lu , Jian Shao , Jun Xiao , Yueting Zhuang

Off-policy evaluation and learning in contextual bandits use logged interaction data to estimate and optimize the value of a target policy. Most existing methods require sufficient action overlap between the logging and target policies, and…

Machine Learning · Statistics 2026-02-03 Shu Tamano

Behavioral skills or policies for autonomous agents are conventionally learned from reward functions, via reinforcement learning, or from demonstrations, via imitation learning. However, both modes of task specification have their…

Decentralized execution is one core demand in multi-agent reinforcement learning (MARL). Recently, most popular MARL algorithms have adopted decentralized policies to enable decentralized execution, and use gradient descent as the…

Multiagent Systems · Computer Science 2025-12-30 Jianing Ye , Chenghao Li , Yongqiang Dou , Jianhao Wang , Guangwen Yang , Chongjie Zhang

Large Language Model (LLM) agents have demonstrated impressive capabilities in handling complex interactive problems. Existing LLM agents mainly generate natural language plans to guide reasoning, which is verbose and inefficient. NL plans…

Artificial Intelligence · Computer Science 2025-06-03 Zouying Cao , Runze Wang , Yifei Yang , Xinbei Ma , Xiaoyong Zhu , Bo Zheng , Hai Zhao

Aligning language models (LMs) to human preferences has emerged as a critical pursuit, enabling these models to better serve diverse user needs. Existing methods primarily focus on optimizing LMs for a single reward function, limiting their…

Machine Learning · Computer Science 2024-10-29 Ruizhe Shi , Yifang Chen , Yushi Hu , Alisa Liu , Hannaneh Hajishirzi , Noah A. Smith , Simon S. Du

General agents have given rise to phenomenal applications such as OpenClaw and Claude Code. As these agent systems (a.k.a. Harnesses) strive for bolder goals, they demand increasingly stronger agentic capabilities from foundation Large…

Computation and Language · Computer Science 2026-04-21 Daoyu Wang , Qingchuan Li , Mingyue Cheng , Jie Ouyang , Shuo Yu , Qi Liu , Enhong Chen

In reinforcement learning, agents often learn policies for specific tasks without the ability to generalize this knowledge to related tasks. This paper introduces an algorithm that attempts to address this limitation by decomposing neural…

Machine Learning · Computer Science 2024-10-16 Mahdi Alikhasi , Levi H. S. Lelis

In recent years, multi-agent reinforcement learning algorithms have made significant advancements in diverse gaming environments, leading to increased interest in the broader application of such techniques. To address the prevalent…

Multiagent Systems · Computer Science 2024-04-30 Dapeng Li , Hang Dong , Lu Wang , Bo Qiao , Si Qin , Qingwei Lin , Dongmei Zhang , Qi Zhang , Zhiwei Xu , Bin Zhang , Guoliang Fan

Reinforcement learning algorithms are fundamental to align large language models with human preferences and to enhance their reasoning capabilities. However, current reinforcement learning algorithms often suffer from training instability…

Machine Learning · Computer Science 2025-06-05 Yaru Hao , Li Dong , Xun Wu , Shaohan Huang , Zewen Chi , Furu Wei

This study investigates cooperation evolution mechanisms in the spatial public goods game. A novel deep reinforcement learning framework, Proximal Policy Optimization with Adversarial Curriculum Transfer (PPO-ACT), is proposed to model…

Computer Science and Game Theory · Computer Science 2025-07-03 Zhaoqilin Yang , Chanchan Li , Xin Wang , Youliang Tian

Large language models (LLMs) increasingly rely on multi-turn tool-integrated planning for knowledge-intensive and complex reasoning tasks. Existing implementations typically rely on a single agent, but they suffer from limited context…

Computation and Language · Computer Science 2025-10-07 Zhanfeng Mo , Xingxuan Li , Yuntao Chen , Lidong Bing

Recent advancements in large language models (LLMs) have enabled LLM-based agents to successfully tackle interactive planning tasks. However, despite their successes, existing approaches often suffer from planning hallucinations and require…

Computation and Language · Computer Science 2025-09-11 Weimin Xiong , Yifan Song , Qingxiu Dong , Bingchan Zhao , Feifan Song , Xun Wang , Sujian Li

Effective social intelligence simulation requires language agents to dynamically adjust reasoning depth, a capability notably absent in current studies. Existing methods either lack explicit reasoning or employ lengthy Chain-of-Thought…

Computation and Language · Computer Science 2026-03-04 Minzheng Wang , Yongbin Li , Haobo Wang , Xinghua Zhang , Nan Xu , Bingli Wu , Fei Huang , Haiyang Yu , Wenji Mao

Recent advances in explainable recommendations have explored the integration of language models to analyze natural language rationales for user-item interactions. Despite their potential, existing methods often rely on ID-based…

Machine Learning · Computer Science 2025-12-18 Xinshun Feng , Mingzhe Liu , Yi Qiao , Tongyu Zhu , Leilei Sun , Shuai Wang

The integration of artificial intelligence across multiple domains has emphasized the importance of replicating human-like cognitive processes in AI. By incorporating emotional intelligence into AI agents, their emotional stability can be…

Artificial Intelligence · Computer Science 2024-07-31 Hari Prasad , Chinnu Jacob , Imthias Ahamed T. P

Multi-turn GUI agents enable complex task completion through sequential decision-making, but suffer from severe context inflation as interaction history accumulates. Existing strategies either sacrifice long-term context via truncation or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yurun Song , Jiong Yin , Rongjunchen Zhang , Ian G. Harris

Large language model (LLM) agents have recently demonstrated impressive capabilities in various domains like open-ended conversation and multi-step decision-making. However, it remains challenging for these agents to solve strategic…

Artificial Intelligence · Computer Science 2025-06-19 Zelai Xu , Wanjun Gu , Chao Yu , Yi Wu , Yu Wang

The policy gradient method enjoys the simplicity of the objective where the agent optimizes the cumulative reward directly. Moreover, in the continuous action domain, parameterized distribution of action distribution allows easy control of…

Machine Learning · Computer Science 2022-12-16 Md Masudur Rahman , Yexiang Xue