中文
相关论文

相关论文: Prompt Informed Reinforcement Learning for Visual …

200 篇论文

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

机器学习 · 计算机科学 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

机器人学 · 计算机科学 2019-05-31 Maxime Bouton , Jesper Karlsson , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer , Jana Tumova

Overfitting in RL has become one of the main obstacles to applications in reinforcement learning(RL). Existing methods do not provide explicit semantic constrain for the feature extractor, hindering the agent from learning a unified…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Haihan Gao , Rui Zhang , Qi Yi , Hantao Yao , Haochen Li , Jiaming Guo , Shaohui Peng , Yunkai Gao , QiCheng Wang , Xing Hu , Yuanbo Wen , Zihao Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

机器人学 · 计算机科学 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Interactive reinforcement learning (IRL) extends traditional reinforcement learning (RL) by allowing an agent to interact with parent-like trainers during a task. In this paper, we present an IRL approach using dynamic audio-visual input in…

人工智能 · 计算机科学 2018-07-27 Francisco Cruz , German I. Parisi , Stefan Wermter

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

机器学习 · 计算机科学 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Modern autonomous drone missions increasingly require software frameworks capable of seamlessly integrating structured symbolic planning with adaptive reinforcement learning (RL). Although traditional rule-based architectures offer robust…

机器人学 · 计算机科学 2026-01-13 Sangwoo Jeon , Juchul Shin , YeonJe Cho , Gyeong-Tae Kim , Seongwoo Kim

Image-based reinforcement learning (RL) faces significant challenges in generalization when the visual environment undergoes substantial changes between training and deployment. Under such circumstances, learned policies may not perform…

机器人学 · 计算机科学 2024-07-25 Weiyao Wang , Xinyuan Fang , Gregory D. Hager

Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigates the feasibility of using PPO for direct reinforcement…

计算与语言 · 计算机科学 2024-10-23 Alexander G. Padula , Dennis J. N. J. Soemers

It is important for deep reinforcement learning (DRL) algorithms to transfer their learned policies to new environments that have different visual inputs. In this paper, we introduce Prompt based Proximal Policy Optimization ($P^{3}O$), a…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Guoliang You , Xiaomeng Chu , Yifan Duan , Jie Peng , Jianmin Ji , Yu Zhang , Yanyong Zhang

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

机器学习 · 计算机科学 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

VLMs excel at static perception but falter in interactive reasoning in dynamic physical environments, which demands planning and adaptation to dynamic outcomes. Existing physical reasoning methods often depend on abstract symbolic inputs or…

机器学习 · 计算机科学 2026-03-17 Xinrun Xu , Pi Bu , Ye Wang , Börje F. Karlsson , Ziming Wang , Tengtao Song , Qi Zhu , Jun Song , Shuo Zhang , Zhiming Ding , Bo Zheng

The inclusion of physical information in machine learning frameworks has revolutionized many application areas. This involves enhancing the learning process by incorporating physical constraints and adhering to physical laws. In this work…

机器学习 · 计算机科学 2025-06-06 Chayan Banerjee , Kien Nguyen , Clinton Fookes , Maziar Raissi

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

机器学习 · 计算机科学 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

系统与控制 · 电气工程与系统科学 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

Performance and reliability analyses of autonomous vehicles (AVs) can benefit from tools that ``amplify'' small datasets to synthesize larger volumes of plausible samples of the AV's behavior. We consider a specific instance of this data…

机器学习 · 计算机科学 2025-03-11 Alexandra E. Ballentine , Raghvendra V. Cowlagi

Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in shaping robot behavior by expressing preferences on different sequences of state-action pairs. However,…

机器人学 · 计算机科学 2024-02-26 Simon Holk , Daniel Marta , Iolanda Leite

In Reinforcement Learning (RL), agents have no incentive to exhibit predictable behaviors, and are often pushed (through e.g. policy entropy regularisation) to randomise their actions in favor of exploration. This often makes it challenging…

机器学习 · 计算机科学 2025-06-04 Daniel Jarne Ornia , Giannis Delimpaltadakis , Jens Kober , Javier Alonso-Mora

In this paper, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any…

信号处理 · 电气工程与系统科学 2021-03-04 Yuanjian Li , A. Hamid Aghvami , Daoyi Dong

We study reinforcement learning (RL) with no-reward demonstrations, a setting in which an RL agent has access to additional data from the interaction of other agents with the same environment. However, it has no access to the rewards or…

机器学习 · 计算机科学 2021-06-11 Angelos Filos , Clare Lyle , Yarin Gal , Sergey Levine , Natasha Jaques , Gregory Farquhar