中文
相关论文

相关论文: SPRINQL: Sub-optimal Demonstrations driven Offline…

200 篇论文

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum…

量子物理 · 物理学 2023-04-06 Zhihao Cheng , Kaining Zhang , Li Shen , Dacheng Tao

Learning from offline task demonstrations is a problem of great interest in robotics. For simple short-horizon manipulation tasks with modest variation in task instances, offline learning from a small set of demonstrations can produce…

机器人学 · 计算机科学 2020-02-25 Ajay Mandlekar , Fabio Ramos , Byron Boots , Silvio Savarese , Li Fei-Fei , Animesh Garg , Dieter Fox

There has been significant recent progress in the area of unsupervised skill discovery, utilizing various information-theoretic objectives as measures of diversity. Despite these advances, challenges remain: current methods require…

机器学习 · 计算机科学 2024-06-24 Marin Vlastelica , Jin Cheng , Georg Martius , Pavel Kolev

Accurate estimation of the Q-function is a central challenge in offline reinforcement learning. However, existing approaches often rely on a shared global Q-function, which is inadequate for capturing the compositional structure of tasks…

机器学习 · 计算机科学 2026-03-19 Qiushui Xu , Yuhao Huang , Yushu Jiang , Lei Song , Jinyu Wang , Wenliang Zheng , Jiang Bian

Imitation Learning (IL) has emerged as a powerful approach in robotics, allowing robots to acquire new skills by mimicking human actions. Despite its potential, the data collection process for IL remains a significant challenge due to the…

机器人学 · 计算机科学 2025-05-23 Hamidreza Kasaei , Mohammadreza Kasaei

Offline-to-online reinforcement learning (RL) improves sample efficiency by leveraging pre-collected datasets prior to online interaction. A key challenge, however, is learning an accurate critic in large state--action spaces with limited…

人工智能 · 计算机科学 2026-05-21 Andrew Choi , Wei Xu

While imitation learning (IL) offers a promising framework for teaching robots various behaviors, learning complex tasks remains challenging. Existing IL policies struggle to generalize effectively across visual and spatial variations even…

机器人学 · 计算机科学 2024-12-10 Priya Sundaresan , Hengyuan Hu , Quan Vuong , Jeannette Bohg , Dorsa Sadigh

Although robotic imitation learning (RIL) is promising for embodied intelligent robots, existing RIL approaches rely on computationally intensive multi-model trajectory predictions, resulting in slow execution and limited real-time…

机器人学 · 计算机科学 2024-12-31 Jun Xie , Zhicheng Wang , Jianwei Tan , Huanxu Lin , Xiaoguang Ma

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

机器学习 · 计算机科学 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Inspired by the recent successes of Inverse Optimization (IO) across various application domains, we propose a novel offline Reinforcement Learning (ORL) algorithm for continuous state and action spaces, leveraging the convex loss function…

机器学习 · 计算机科学 2026-03-19 Ioannis Dimanidis , Tolga Ok , Peyman Mohajerin Esfahani

Inverse Reinforcement Learning (IRL) presents a powerful paradigm for learning complex robotic tasks from human demonstrations. However, most approaches make the assumption that expert demonstrations are available, which is often not the…

机器学习 · 计算机科学 2025-07-14 Peter Crowley , Zachary Serlin , Tyler Paine , Makai Mann , Michael Benjamin , Calin Belta

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

机器学习 · 计算机科学 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

Imitation learning (IL) has proven to be an effective method for learning good policies from expert demonstrations. Adversarial imitation learning (AIL), a subset of IL methods, is particularly promising, but its theoretical foundation in…

机器学习 · 计算机科学 2023-06-14 Tian Xu , Ziniu Li , Yang Yu , Zhi-Quan Luo

In offline imitation learning (IL), we generally assume only a handful of expert trajectories and a supplementary offline dataset from suboptimal behaviors to learn the expert policy. While it is now common to minimize the divergence…

机器学习 · 计算机科学 2024-01-19 Hee-Jun Ahn , Seong-Woong Shim , Byung-Jun Lee

Surgical robot task automation has recently attracted great attention due to its potential to benefit both surgeons and patients. Reinforcement learning (RL) based approaches have demonstrated promising ability to provide solutions to…

机器人学 · 计算机科学 2024-09-12 Jingshuai Liu , Alain Andres , Yonghang Jiang , Xichun Luo , Wenmiao Shu , Sotirios A. Tsaftaris

This work develops new algorithms with rigorous efficiency guarantees for infinite horizon imitation learning (IL) with linear function approximation without restrictive coherence assumptions. We begin with the minimax formulation of the…

机器学习 · 计算机科学 2023-05-31 Luca Viano , Angeliki Kamoutsi , Gergely Neu , Igor Krawczuk , Volkan Cevher

We study offline reinforcement learning of style-conditioned policies using explicit style supervision via subtrajectory labeling functions. In this setting, aligning style with high task performance is particularly challenging due to…

机器学习 · 计算机科学 2026-02-02 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier

Imitation Learning (IL) aims to discover a policy by minimizing the discrepancy between the agent's behavior and expert demonstrations. However, IL is susceptible to limitations imposed by noisy demonstrations from non-expert behaviors,…

机器学习 · 计算机科学 2023-10-25 Ye Yuan , Xin Li , Yong Heng , Leiji Zhang , MingZhong Wang

Imitation learning (IL) enables agents to acquire skills directly from expert demonstrations, providing a compelling alternative to reinforcement learning. However, prior online IL approaches struggle with complex tasks characterized by…

机器学习 · 计算机科学 2025-05-13 Shangzhe Li , Zhiao Huang , Hao Su

Sequential decision making algorithms often struggle to leverage different sources of unstructured offline interaction data. Imitation learning (IL) methods based on supervised learning are robust, but require optimal demonstrations, which…

机器学习 · 计算机科学 2023-04-28 Joey Hejna , Jensen Gao , Dorsa Sadigh