中文
相关论文

相关论文: ExTra: Transfer-guided Exploration

200 篇论文

Imitation learning is a central problem in reinforcement learning where the goal is to learn a policy that mimics the expert's behavior. In practice, it is often challenging to learn the expert policy from a limited number of demonstrations…

机器学习 · 计算机科学 2025-06-26 Heyang Zhao , Xingrui Yu , David M. Bossens , Ivor W. Tsang , Quanquan Gu

In many dynamic robotic tasks, such as striking pucks into a goal outside the reachable workspace, the robot must first identify the relevant physical properties of the object for successful task execution, as it is unable to recover from…

机器人学 · 计算机科学 2025-09-03 Marina Y. Aoyama , Joao Moura , Juan Del Aguila Ferrandis , Sethu Vijayakumar

Temporal abstractions in the form of options have been shown to help reinforcement learning (RL) agents learn faster. However, despite prior work on this topic, the problem of discovering options through interaction with an environment…

Although exploratory behaviors are ubiquitous in the animal kingdom, their computational underpinnings are still largely unknown. Behavioral Psychology has identified learning as a primary drive underlying many exploratory behaviors.…

机器学习 · 计算机科学 2011-12-14 Daniel Y. Little , Friedrich T. Sommer

Learning complex robot behavior through interactions with the environment necessitates principled exploration. Effective strategies should prioritize exploring regions of the state-action space that maximize rewards, with optimistic…

机器学习 · 计算机科学 2025-03-12 Jasmine Bayrooti , Carl Henrik Ek , Amanda Prorok

The Centralized Training with Decentralized Execution (CTDE) paradigm is widely used in cooperative multi-agent reinforcement learning. However, conventional methods based on CTDE can suffer from value underestimation and converge to…

多智能体系统 · 计算机科学 2026-05-05 Ruoning Zhang , Siying Wang , Wenyu Chen , Yang Zhou , Zhitong Zhao , Zixuan Zhang , Ruijie Zhang , Stefano V. Albrecht

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

人工智能 · 计算机科学 2018-01-23 Girish Joshi , Girish Chowdhary

Intrinsically motivated reinforcement learning aims to address the exploration challenge for sparse-reward tasks. However, the study of exploration methods in transition-dependent multi-agent settings is largely absent from the literature.…

机器学习 · 计算机科学 2019-12-30 Tonghan Wang , Jianhao Wang , Yi Wu , Chongjie Zhang

Controlling high-dimensional systems in biological and robotic applications is challenging due to expansive state-action spaces, where effective exploration is critical. Commonly used exploration strategies in reinforcement learning are…

机器学习 · 计算机科学 2026-01-28 Yunyue Wei , Chenhui Zuo , Yanan Sui

Efficient exploration is one of the main challenges in reinforcement learning (RL). Most existing sample-efficient algorithms assume the existence of a single reward function during exploration. In many practical scenarios, however, there…

机器学习 · 计算机科学 2020-06-18 Xuezhou Zhang , Yuzhe ma , Adish Singla

The ability to explore efficiently and effectively is a central challenge of reinforcement learning. In this work, we consider exploration through the lens of information theory. Specifically, we cast exploration as a problem of maximizing…

Adversarial attacks present a critical challenge to deep neural networks' robustness, particularly in transfer scenarios across different model architectures. However, the transferability of adversarial attacks faces a fundamental dilemma…

机器学习 · 计算机科学 2025-11-04 Zenghao Niu , Weicheng Xie , Siyang Song , Zitong Yu , Feng Liu , Linlin Shen

A key challenge in reinforcement learning (RL) is environment generalization: a policy trained to solve a task in one environment often fails to solve the same task in a slightly different test environment. A common approach to improve…

机器人学 · 计算机科学 2019-07-30 Wenxuan Zhou , Lerrel Pinto , Abhinav Gupta

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

机器学习 · 计算机科学 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta

Autonomous exploration of obstacle-rich spaces requires strategies that ensure efficiency while guaranteeing safety against collisions with obstacles. This paper investigates a novel platform-agnostic reinforcement learning framework that…

机器人学 · 计算机科学 2025-11-20 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

In safe reinforcement learning, agent needs to balance between exploration actions and safety constraints. Following this paradigm, domain transfer approaches learn a prior Q-function from the related environments to prevent unsafe actions.…

机器学习 · 计算机科学 2025-04-29 Duc Kien Doan , Bang Giang Le , Viet Cuong Ta

Policy gradient reinforcement learning techniques enable an agent to directly learn an optimal action policy through the interactions with the environment. Nevertheless, despite its advantages, it sometimes suffers from slow convergence…

信息论 · 计算机科学 2020-08-05 Mohammad G. Khoshkholgh , Halim Yanikomeroglu

Reinforcement learning with sparse rewards is challenging because an agent can rarely obtain non-zero rewards and hence, gradient-based optimization of parameterized policies can be incremental and slow. Recent work demonstrated that using…

机器学习 · 计算机科学 2021-02-16 Yijie Guo , Jongwook Choi , Marcin Moczulski , Shengyu Feng , Samy Bengio , Mohammad Norouzi , Honglak Lee

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

机器学习 · 统计学 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

机器学习 · 计算机科学 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley