中文
相关论文

相关论文: Discriminator-Guided Model-Based Offline Imitation…

200 篇论文

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

神经与进化计算 · 计算机科学 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster

Edge computation offloading allows mobile end devices to put execution of compute-intensive task on the edge servers. End devices can decide whether offload the tasks to edge servers, cloud servers or execute locally according to current…

网络与互联网体系结构 · 计算机科学 2020-04-10 Haowei Chen , Liekang Zeng , Shuai Yu , Xu Chen

Offline reinforcement learning (RL) faces a significant challenge of distribution shift. Model-free offline RL penalizes the Q value for out-of-distribution (OOD) data or constrains the policy closed to the behavior policy to tackle this…

机器学习 · 计算机科学 2024-04-18 Xiao-Yin Liu , Xiao-Hu Zhou , Guotao Li , Hao Li , Mei-Jiang Gui , Tian-Yu Xiang , De-Xing Huang , Zeng-Guang Hou

Diffusion-based world models have demonstrated strong capabilities in synthesizing realistic long-horizon trajectories for offline reinforcement learning (RL). However, many existing methods do not directly generate actions alongside states…

机器学习 · 计算机科学 2026-05-14 Zongyue Li , Xiao Han , Yusong Li , Niklas Strauss , Matthias Schubert

In offline imitation learning (IL), we generally assume only a handful of expert trajectories and a supplementary offline dataset from suboptimal behaviors to learn the expert policy. While it is now common to minimize the divergence…

机器学习 · 计算机科学 2024-01-19 Hee-Jun Ahn , Seong-Woong Shim , Byung-Jun Lee

Offline Goal-Conditioned Reinforcement Learning (GCRL) is tasked with learning to achieve multiple goals in an environment purely from offline datasets using sparse reward functions. Offline GCRL is pivotal for developing generalist agents…

机器学习 · 计算机科学 2024-03-01 Harshit Sikchi , Rohan Chitnis , Ahmed Touati , Alborz Geramifard , Amy Zhang , Scott Niekum

Current lane detection methods are struggling with the invisibility lane issue caused by heavy shadows, severe road mark degradation, and serious vehicle occlusion. As a result, discriminative lane features can be barely learned by the…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Yue He , Minyue Jiang , Xiaoqing Ye , Liang Du , Zhikang Zou , Wei Zhang , Xiao Tan , Errui Ding

Reinforcement learning from expert demonstrations has long remained a challenging research problem, and existing state-of-the-art methods using behavioral cloning plus further RL training often suffer from poor generalization, low sample…

机器学习 · 计算机科学 2025-05-07 Borui Wang , Kathleen McKeown , Rex Ying

Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy for stable and…

机器学习 · 计算机科学 2022-05-24 Hana Hoshino , Kei Ota , Asako Kanezaki , Rio Yokota

Imitation learning is a central problem in reinforcement learning where the goal is to learn a policy that mimics the expert's behavior. In practice, it is often challenging to learn the expert policy from a limited number of demonstrations…

机器学习 · 计算机科学 2025-06-26 Heyang Zhao , Xingrui Yu , David M. Bossens , Ivor W. Tsang , Quanquan Gu

Generative models such as diffusion have been employed as world models in offline reinforcement learning to generate synthetic data for more effective learning. Existing work either generates diffusion models one-time prior to training or…

机器学习 · 计算机科学 2024-05-31 Zeyu Fang , Tian Lan

Recently, the robotics community has amassed ever larger and more diverse datasets to train generalist robot policies. However, while these policies achieve strong mean performance across a variety of tasks, they often underperform on…

机器人学 · 计算机科学 2025-05-15 Shivin Dass , Alaa Khaddaj , Logan Engstrom , Aleksander Madry , Andrew Ilyas , Roberto Martín-Martín

Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot's behavior. In recent years, IIL has increasingly…

Many existing imitation learning datasets are collected from multiple demonstrators, each with different expertise at different parts of the environment. Yet, standard imitation learning algorithms typically treat all demonstrators as…

机器学习 · 计算机科学 2022-06-14 Mark Beliaev , Andy Shih , Stefano Ermon , Dorsa Sadigh , Ramtin Pedarsani

The deployment of machine learning solutions in real-world scenarios often involves addressing the challenge of out-of-distribution (OOD) detection. While significant efforts have been devoted to OOD detection in classical supervised…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Loïc Le Bescond , Maria Vakalopoulou , Stergios Christodoulidis , Fabrice André , Hugues Talbot

Multi-instance learning (MIL) deals with tasks where data is represented by a set of bags and each bag is described by a set of instances. Unlike standard supervised learning, only the bag labels are observed whereas the label for each…

机器学习 · 计算机科学 2021-04-27 Weijia Zhang , Jiuyong Li , Lin Liu

Achieving carbon neutrality within industrial operations has become increasingly imperative for sustainable development. It is both a significant challenge and a key opportunity for operational optimization in industry 4.0. In recent years,…

机器学习 · 计算机科学 2024-07-15 Yuyang Ye , Lu-An Tang , Haoyu Wang , Runlong Yu , Wenchao Yu , Erhu He , Haifeng Chen , Hui Xiong

Behavior cloning (BC) is often practical for robot learning because it allows a policy to be trained offline without rewards, by supervised learning on expert demonstrations. However, BC does not effectively leverage what we will refer to…

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

机器学习 · 计算机科学 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In…

机器学习 · 计算机科学 2021-12-14 Yang Liu , Yongzhe Chang , Shilei Jiang , Xueqian Wang , Bin Liang , Bo Yuan