English
Related papers

Related papers: Policy Learning with a Natural Language Action Spa…

200 papers

Large language model (LLM) agents have recently demonstrated impressive capabilities in various domains like open-ended conversation and multi-step decision-making. However, it remains challenging for these agents to solve strategic…

Artificial Intelligence · Computer Science 2025-06-19 Zelai Xu , Wanjun Gu , Chao Yu , Yi Wu , Yu Wang

Transfer Learning (TL) has shown great potential to accelerate Reinforcement Learning (RL) by leveraging prior knowledge from past learned policies of relevant tasks. Existing transfer approaches either explicitly computes the similarity…

Policy search can in principle acquire complex strategies for control of robots and other autonomous systems. When the policy is trained to process raw sensory inputs, such as images and depth maps, it can also acquire a strategy that…

Machine Learning · Computer Science 2017-02-28 Gregory Kahn , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Traditionally, approximate dynamic programming is employed in dialogue generation with greedy policy improvement through action sampling, as the natural language action space is vast. However, this practice is inefficient for reinforcement…

Computation and Language · Computer Science 2023-05-16 Itsugun Cho , Ryota Takahashi , Yusaku Yanase , Hiroaki Saito

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

There is a growing desire in the field of reinforcement learning (and machine learning in general) to move from black-box models toward more "interpretable AI." We improve interpretability of reinforcement learning by increasing the utility…

Machine Learning · Computer Science 2019-07-03 Aaron M. Roth , Nicholay Topin , Pooyan Jamshidi , Manuela Veloso

Reinforcement learning (RL) has emerged as a promising paradigm for inducing explicit reasoning behaviors in large language and vision-language models. However, reasoning-oriented RL post-training remains fundamentally challenging due to…

Artificial Intelligence · Computer Science 2026-05-13 Fan Yang , Rui Meng , Trudi Di Qi , Ali Ezzati , Yuxin Wen

Precision medicine aims to tailor therapeutic decisions to individual patient characteristics. This objective is commonly formalized through dynamic treatment regimes, which use statistical and machine learning methods to derive sequential…

Machine Learning · Statistics 2026-03-23 Sophia Yazzourh , Erica E. M. Moodie

Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited…

Computation and Language · Computer Science 2017-08-09 Meng Fang , Yuan Li , Trevor Cohn

The ability to exploit prior experience to solve novel problems rapidly is a hallmark of biological learning systems and of great practical importance for artificial ones. In the meta reinforcement learning literature much recent work has…

Recent advances in large language models (LLMs) have broadened their applicability across diverse tasks, yet specialized domains still require targeted post training. Among existing methods, Group Relative Policy Optimization (GRPO) stands…

Machine Learning · Computer Science 2025-08-08 Ziyin Gu , Jingyao Wang , Ran Zuo , Chuxiong Sun , Zeen Song , Changwen Zheng , Wenwen Qiang

In this work we propose a novel end-to-end imitation learning approach which combines natural language, vision, and motion information to produce an abstract representation of a task, which in turn is used to synthesize specific motion…

Robotics · Computer Science 2019-11-27 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Chitta Baral , Heni Ben Amor

Defining action spaces for conversational agents and optimizing their decision-making process with reinforcement learning is an enduring challenge. Common practice has been to use handcrafted dialog acts, or the output vocabulary, e.g. in…

Computation and Language · Computer Science 2019-04-16 Tiancheng Zhao , Kaige Xie , Maxine Eskenazi

Policy-Space Response Oracles (PSRO) is a general algorithmic framework for learning policies in multiagent systems by interleaving empirical game analysis with deep reinforcement learning (Deep RL). At each iteration, Deep RL is invoked to…

Multiagent Systems · Computer Science 2021-06-04 Max Olan Smith , Thomas Anthony , Michael P. Wellman

Many robotic tasks are composed of a lot of temporally correlated sub-tasks in a highly complex environment. It is important to discover situational intentions and proper actions by deliberating on temporal abstractions to solve problems…

Machine Learning · Computer Science 2022-07-26 Se-Wook Yoo , Seung-Woo Seo

To facilitate efficient learning, policy gradient approaches to deep reinforcement learning (RL) are typically paired with variance reduction measures and strategies for making large but safe policy changes based on a batch of experiences.…

Machine Learning · Computer Science 2023-11-13 Jared Markowitz , Edward W. Staley

Existing policy-gradient methods for auto-regressive language models typically select subsequent tokens one at a time as actions in the policy. While effective for many generation tasks, such an approach may not fully capture the structure…

Computation and Language · Computer Science 2026-02-17 Mufan Xu , Kehai Chen , Xuefeng Bai , Zhengyu Niu , Muyun Yang , Tiejun Zhao , Min Zhang

Reinforcement learning algorithms such as group-relative policy optimization (GRPO) have shown strong potential for improving the mathematical reasoning capabilities of large language models. While a growing body of work seeks to improve…

Machine Learning · Computer Science 2026-05-12 Wenquan Lu , Hai Huang , Enqi Liu , Randall Balestriero

Dynamic decisions are pivotal to economic policy making. We show how existing evidence from randomized control trials can be utilized to guide personalized decisions in challenging dynamic environments with budget and capacity constraints.…

Econometrics · Economics 2024-11-26 Karun Adusumilli , Friedrich Geiecke , Claudio Schilter