English
Related papers

Related papers: Reinforcement Learning with Foundation Priors: Let…

200 papers

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

Robotics · Computer Science 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

Reinforcement learning (RL) in episodic, factored Markov decision processes (FMDPs) is studied. We propose an algorithm called FMDP-BF, which leverages the factorization structure of FMDP. The regret of FMDP-BF is shown to be exponentially…

Machine Learning · Computer Science 2021-03-11 Xiaoyu Chen , Jiachen Hu , Lihong Li , Liwei Wang

Despite recent success of deep network-based Reinforcement Learning (RL), it remains elusive to achieve human-level efficiency in learning novel tasks. While previous efforts attempt to address this challenge using meta-learning strategies,…

Machine Learning · Computer Science 2022-05-03 Haozhe Wang , Jiale Zhou , Xuming He

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Enabling robots to execute long-horizon manipulation tasks from free-form language instructions remains a fundamental challenge in embodied AI. While vision-language models (VLMs) have shown promise as high-level planners, their deployment…

Robotics · Computer Science 2025-10-01 Zitong Bo , Yue Hu , Jinming Ma , Mingliang Zhou , Junhui Yin , Yachen Kang , Yuqi Liu , Tong Wu , Diyun Xiang , Hao Chen

Reinforcement learning (RL) has the potential to transform real-world decision-making systems by enabling autonomous agents to learn from experience. Deploying RL in real-world settings, especially in the context of human-robot interaction,…

Machine Learning · Computer Science 2026-02-04 Saurav Singh , Rodney Sanchez , Alexander Ororbia , Jamison Heard

The potential benefits of model-free reinforcement learning to real robotics systems are limited by its uninformed exploration that leads to slow convergence, lack of data-efficiency, and unnecessary interactions with the environment. To…

Robotics · Computer Science 2020-11-04 Yuchen Wu , Melissa Mozifian , Florian Shkurti

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are hard to leverage in real-world systems due…

Machine Learning · Computer Science 2021-03-05 Gabriel Dulac-Arnold , Nir Levine , Daniel J. Mankowitz , Jerry Li , Cosmin Paduraru , Sven Gowal , Todd Hester

Providing Reinforcement Learning (RL) agents with human feedback can dramatically improve various aspects of learning. However, previous methods require human observer to give inputs explicitly (e.g., press buttons, voice interface),…

Neural and Evolutionary Computing · Computer Science 2020-10-15 Duo Xu , Mohit Agarwal , Ekansh Gupta , Faramarz Fekri , Raghupathy Sivakumar

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Recent unsupervised pre-training methods have shown to be effective on language and vision domains by learning useful representations for multiple downstream tasks. In this paper, we investigate if such unsupervised pre-training methods can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Younggyo Seo , Kimin Lee , Stephen James , Pieter Abbeel

Reinforcement learning (RL) algorithms are highly sensitive to reward function specification, which remains a central challenge limiting their broad applicability. We present ARM-FM: Automated Reward Machines via Foundation Models, a…

Artificial Intelligence · Computer Science 2026-03-10 Roger Creus Castanyer , Faisal Mohamed , Pablo Samuel Castro , Cyrus Neary , Glen Berseth

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

It is a long-standing problem to find effective representations for training reinforcement learning (RL) agents. This paper demonstrates that learning state representations with supervision from Neural Radiance Fields (NeRFs) can improve…

Machine Learning · Computer Science 2022-06-06 Danny Driess , Ingmar Schubert , Pete Florence , Yunzhu Li , Marc Toussaint

Everything else being equal, simpler models should be preferred over more complex ones. In reinforcement learning (RL), simplicity is typically quantified on an action-by-action basis -- but this timescale ignores temporal regularities,…

Machine Learning · Computer Science 2023-05-29 Tankred Saanum , Noémi Éltető , Peter Dayan , Marcel Binz , Eric Schulz

Reinforcement learning has emerged as a powerful paradigm for post-training large language models (LLMs) to improve reasoning. Approaches like Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with Verifiable…

Machine Learning · Computer Science 2025-06-26 Yanzhi Zhang , Zhaoxi Zhang , Haoxiang Guan , Yilin Cheng , Yitong Duan , Chen Wang , Yue Wang , Shuxin Zheng , Jiyan He

Reinforcement Learning with Verifiable Rewards~(RLVR) has emerged as a powerful learn-to-reason paradigm for large reasoning models to tackle complex tasks. However, the current RLVR paradigm is still not efficient enough, as it works in a…

Computation and Language · Computer Science 2026-03-10 Junjie Zhang , Guozheng Ma , Shunyu Liu , Haoyu Wang , Jiaxing Huang , Ting-En Lin , Fei Huang , Yongbin Li , Dacheng Tao

Large language models (LLMs) excel at logical and algorithmic reasoning, yet their emotional intelligence (EQ) still lags far behind their cognitive prowess. While reinforcement learning from verifiable rewards (RLVR) has advanced in other…

In recent years, reinforcement learning (RL) has shown great potential for solving tasks in well-defined environments like games or robotics. This paper aims to solve the robotic reaching task in a simulation run on the Neurorobotics…

Robotics · Computer Science 2025-05-21 Marton Szep , Leander Lauenburg , Kevin Farkas , Xiyan Su , Chuanlong Zang