English
Related papers

Related papers: Prompt Informed Reinforcement Learning for Visual …

200 papers

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

Machine Learning · Computer Science 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

Overfitting in RL has become one of the main obstacles to applications in reinforcement learning(RL). Existing methods do not provide explicit semantic constrain for the feature extractor, hindering the agent from learning a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Haihan Gao , Rui Zhang , Qi Yi , Hantao Yao , Haochen Li , Jiaming Guo , Shaohui Peng , Yunkai Gao , QiCheng Wang , Xing Hu , Yuanbo Wen , Zihao Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

Robotics · Computer Science 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Interactive reinforcement learning (IRL) extends traditional reinforcement learning (RL) by allowing an agent to interact with parent-like trainers during a task. In this paper, we present an IRL approach using dynamic audio-visual input in…

Artificial Intelligence · Computer Science 2018-07-27 Francisco Cruz , German I. Parisi , Stefan Wermter

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

Machine Learning · Computer Science 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Modern autonomous drone missions increasingly require software frameworks capable of seamlessly integrating structured symbolic planning with adaptive reinforcement learning (RL). Although traditional rule-based architectures offer robust…

Robotics · Computer Science 2026-01-13 Sangwoo Jeon , Juchul Shin , YeonJe Cho , Gyeong-Tae Kim , Seongwoo Kim

Image-based reinforcement learning (RL) faces significant challenges in generalization when the visual environment undergoes substantial changes between training and deployment. Under such circumstances, learned policies may not perform…

Robotics · Computer Science 2024-07-25 Weiyao Wang , Xinyuan Fang , Gregory D. Hager

Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigates the feasibility of using PPO for direct reinforcement…

Computation and Language · Computer Science 2024-10-23 Alexander G. Padula , Dennis J. N. J. Soemers

It is important for deep reinforcement learning (DRL) algorithms to transfer their learned policies to new environments that have different visual inputs. In this paper, we introduce Prompt based Proximal Policy Optimization ($P^{3}O$), a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Guoliang You , Xiaomeng Chu , Yifan Duan , Jie Peng , Jianmin Ji , Yu Zhang , Yanyong Zhang

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

VLMs excel at static perception but falter in interactive reasoning in dynamic physical environments, which demands planning and adaptation to dynamic outcomes. Existing physical reasoning methods often depend on abstract symbolic inputs or…

Machine Learning · Computer Science 2026-03-17 Xinrun Xu , Pi Bu , Ye Wang , Börje F. Karlsson , Ziming Wang , Tengtao Song , Qi Zhu , Jun Song , Shuo Zhang , Zhiming Ding , Bo Zheng

The inclusion of physical information in machine learning frameworks has revolutionized many application areas. This involves enhancing the learning process by incorporating physical constraints and adhering to physical laws. In this work…

Machine Learning · Computer Science 2025-06-06 Chayan Banerjee , Kien Nguyen , Clinton Fookes , Maziar Raissi

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

Machine Learning · Computer Science 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

Performance and reliability analyses of autonomous vehicles (AVs) can benefit from tools that ``amplify'' small datasets to synthesize larger volumes of plausible samples of the AV's behavior. We consider a specific instance of this data…

Machine Learning · Computer Science 2025-03-11 Alexandra E. Ballentine , Raghvendra V. Cowlagi

Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in shaping robot behavior by expressing preferences on different sequences of state-action pairs. However,…

Robotics · Computer Science 2024-02-26 Simon Holk , Daniel Marta , Iolanda Leite

In Reinforcement Learning (RL), agents have no incentive to exhibit predictable behaviors, and are often pushed (through e.g. policy entropy regularisation) to randomise their actions in favor of exploration. This often makes it challenging…

Machine Learning · Computer Science 2025-06-04 Daniel Jarne Ornia , Giannis Delimpaltadakis , Jens Kober , Javier Alonso-Mora

In this paper, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any…

Signal Processing · Electrical Eng. & Systems 2021-03-04 Yuanjian Li , A. Hamid Aghvami , Daoyi Dong

We study reinforcement learning (RL) with no-reward demonstrations, a setting in which an RL agent has access to additional data from the interaction of other agents with the same environment. However, it has no access to the rewards or…

Machine Learning · Computer Science 2021-06-11 Angelos Filos , Clare Lyle , Yarin Gal , Sergey Levine , Natasha Jaques , Gregory Farquhar