中文
相关论文

相关论文: Generative predecessor models for sample-efficient…

200 篇论文

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

机器学习 · 计算机科学 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

This paper contributes a new approach for distributional reinforcement learning which elucidates a clean separation of transition structure and reward in the learning process. Analogous to how the successor representation (SR) describes the…

The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for…

机器学习 · 计算机科学 2019-03-13 Arjun Sharma , Mohit Sharma , Nicholas Rhinehart , Kris M. Kitani

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

机器人学 · 计算机科学 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

Autonomous urban driving navigation with complex multi-agent dynamics is under-explored due to the difficulty of learning an optimal driving policy. The traditional modular pipeline heavily relies on hand-designed rules and the…

计算机视觉与模式识别 · 计算机科学 2018-07-11 Xiaodan Liang , Tairui Wang , Luona Yang , Eric Xing

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

最优化与控制 · 数学 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Designing a safe and human-like decision-making system for an autonomous vehicle is a challenging task. Generative imitation learning is one possible approach for automating policy-building by leveraging both real-world and simulated…

机器人学 · 计算机科学 2023-06-13 Arec Jamgochian , Etienne Buehrle , Johannes Fischer , Mykel J. Kochenderfer

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

机器学习 · 计算机科学 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

机器学习 · 计算机科学 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

The search for interpretable reinforcement learning policies is of high academic and industrial interest. Especially for industrial systems, domain experts are more likely to deploy autonomously learned controllers if they are…

人工智能 · 计算机科学 2018-04-05 Daniel Hein , Steffen Udluft , Thomas A. Runkler

We formulate the problem of learning to imitate multiple, non-deterministic teachers with minimal interaction cost. Rather than learning a specific policy as in standard imitation learning, the goal in this problem is to learn a…

机器学习 · 计算机科学 2020-06-16 Khanh Nguyen , Hal Daumé

We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and a discriminative model D that estimates the…

Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum…

统计力学 · 物理学 2018-07-20 Zhao-Yu Han , Jun Wang , Heng Fan , Lei Wang , Pan Zhang

Adversarial Imitation Learning (AIL) is a dominant framework in imitation learning that infers rewards from expert demonstrations to guide policy optimization. Although providing more expert demonstrations typically leads to improved…

机器学习 · 计算机科学 2026-04-30 Pengcheng Li , Qiang Fang , Tong Zhao , Yixing Lan , Xin Xu

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

机器学习 · 计算机科学 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum…

量子物理 · 物理学 2023-04-06 Zhihao Cheng , Kaining Zhang , Li Shen , Dacheng Tao

Imitation Learning (IL) methods seek to match the behavior of an agent with that of an expert. In the present work, we propose a new IL method based on a conceptually simple algorithm: Primal Wasserstein Imitation Learning (PWIL), which…

机器学习 · 计算机科学 2021-03-18 Robert Dadashi , Léonard Hussenot , Matthieu Geist , Olivier Pietquin

This paper presents a novel framework for automatic learning of complex strategies in human decision making. The task that we are interested in is to better facilitate long term planning for complex, multi-step events. We observe temporal…

计算机视觉与模式识别 · 计算机科学 2018-05-15 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Graph class-incremental learning (GCIL) allows graph neural networks (GNNs) to adapt to evolving graph analytical tasks by incrementally learning new class knowledge while retaining knowledge of old classes. Existing GCIL methods primarily…

机器学习 · 计算机科学 2025-07-24 Jiazhen Chen , Zheng Ma , Sichao Fu , Mingbin Feng , Tony S. Wirjanto , Weihua Ou

Non-exemplar class-incremental learning (NECIL) is to resist catastrophic forgetting without saving old class samples. Prior methodologies generally employ simple rules to generate features for replaying, suffering from large distribution…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Jichuan Zhang , Yali Li , Xin Liu , Shengjin Wang