中文
相关论文

相关论文: Preventing Imitation Learning with Adversarial Pol…

200 篇论文

Imitation learning considerably simplifies policy synthesis compared to alternative approaches by exploiting access to expert demonstrations. For such imitation policies, errors away from the training samples are particularly critical. Even…

机器学习 · 计算机科学 2024-03-19 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , James Weimer , Insup Lee

We consider the problem of imitation learning under misspecification: settings where the learner is fundamentally unable to replicate expert behavior everywhere. This is often true in practice due to differences in observation space and…

机器学习 · 计算机科学 2025-04-03 Nicolas Espinosa-Dice , Sanjiban Choudhury , Wen Sun , Gokul Swamy

We study automated intrusion prevention using reinforcement learning. In a novel approach, we formulate the problem of intrusion prevention as an optimal stopping problem. This formulation allows us insight into the structure of the optimal…

人工智能 · 计算机科学 2024-04-23 Kim Hammar , Rolf Stadler

Tree ensembles are powerful models that are widely used. However, they are susceptible to adversarial examples, which are examples that purposely constructed to elicit a misprediction from the model. This can degrade performance and erode a…

机器学习 · 计算机科学 2022-06-28 Laurens Devos , Wannes Meert , Jesse Davis

Learning from demonstrations is a popular approach to train AI models; however, their vulnerability to adversarial attacks remains underexplored. We present the first systematic study of adversarial attacks, across a range of both classic…

机器学习 · 计算机科学 2026-04-27 Akansha Kalra , Basavasagar Patil , Guanhong Tao , Daniel S. Brown

One of the common ways children learn is by mimicking adults. Imitation learning focuses on learning policies with suitable performance from demonstrations generated by an expert, with an unspecified performance measure, and unobserved…

机器学习 · 计算机科学 2022-08-15 Junzhe Zhang , Daniel Kumor , Elias Bareinboim

Many reinforcement learning applications involve the use of data that is sensitive, such as medical records of patients or financial information. However, most current reinforcement learning methods can leak information contained within the…

机器学习 · 计算机科学 2019-02-04 Tengyang Xie , Philip S. Thomas , Gerome Miklau

In this paper, the application of imitation learning in caregiving robotics is explored, aiming at addressing the increasing demand for automated assistance in caring for the elderly and disabled. Leveraging advancements in deep learning…

机器人学 · 计算机科学 2024-07-30 Andrii Tytarenko

Reinforcement Learning (RL) has achieved remarkable success in sequential decision tasks. However, recent studies have revealed the vulnerability of RL policies to different perturbations, raising concerns about their effectiveness and…

机器学习 · 计算机科学 2025-07-08 Buqing Nie , Yangqing Fu , Jingtian Ji , Yue Gao

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

机器人学 · 计算机科学 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a…

机器人学 · 计算机科学 2022-09-14 Hao Shen , Weikang Wan , He Wang

While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simple reinforcement…

机器学习 · 计算机科学 2020-12-15 Remi Tachet , Philip Bachman , Harm van Seijen

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

机器学习 · 计算机科学 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

Sample complexity and safety are major challenges when learning policies with reinforcement learning for real-world tasks, especially when the policies are represented using rich function approximators like deep neural networks. Model-based…

机器学习 · 计算机科学 2017-03-07 Aravind Rajeswaran , Sarvjeet Ghotra , Balaraman Ravindran , Sergey Levine

Imitation learning algorithms can be used to learn a policy from expert demonstrations without access to a reward signal. However, most existing approaches are not applicable in multi-agent settings due to the existence of multiple (Nash)…

机器学习 · 计算机科学 2018-07-27 Jiaming Song , Hongyu Ren , Dorsa Sadigh , Stefano Ermon

Single-agent reinforcement learning algorithms in a multi-agent environment are inadequate for fostering cooperation. If intelligent agents are to interact and work together to solve complex problems, methods that counter non-cooperative…

机器学习 · 计算机科学 2022-03-09 Ted Fujimoto , Arthur Paul Pedersen

Existing learning from demonstration algorithms usually assume access to expert demonstrations. However, this assumption is limiting in many real-world applications since the collected demonstrations may be suboptimal or even consist of…

机器人学 · 计算机科学 2022-03-03 Zhangjie Cao , Zihan Wang , Dorsa Sadigh

Imitation learning, followed by reinforcement learning algorithms, is a promising paradigm to solve complex control tasks sample-efficiently. However, learning from demonstrations often suffers from the covariate shift problem, which…

机器学习 · 计算机科学 2019-10-14 Yuping Luo , Huazhe Xu , Tengyu Ma

This work investigates multi-objective imitation learning: the problem of recovering policies that lie on the Pareto front given demonstrations from multiple Pareto-optimal experts in a Multi-Objective Markov Decision Process (MOMDP).…

机器学习 · 计算机科学 2026-05-19 Ziyad Sheebaelhamd , Luca Viano , Volkan Cevher , Claire Vernade

In multi-agent reinforcement learning, the inherent non-stationarity of the environment caused by other agents' actions posed significant difficulties for an agent to learn a good policy independently. One way to deal with non-stationarity…

机器学习 · 计算机科学 2022-06-22 Haobin Jiang , Yifan Yu , Zongqing Lu