English
Related papers

Related papers: Preventing Imitation Learning with Adversarial Pol…

200 papers

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

Machine Learning · Computer Science 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

Machine Learning · Computer Science 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

Machine unlearning refers to the process of mitigating the influence of specific training data on machine learning models based on removal requests from data owners. However, one important area that has been largely overlooked in the…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Congcong Zhu , Derui Wang , Kun Gao , Zewei Shi , Sheng Shen , Wanlei Zhou , Minhui Xue

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

Learning robust driving policies from large-scale, real-world datasets is a central challenge in autonomous driving, as online data collection is often unsafe and impractical. While Behavioral Cloning (BC) offers a straightforward approach…

Machine Learning · Computer Science 2025-08-28 Antonio Guillen-Perez

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Cyber and cyber-physical systems equipped with machine learning algorithms such as autonomous cars share environments with humans. In such a setting, it is important to align system (or agent) behaviors with the preferences of one or more…

Machine Learning · Computer Science 2022-03-22 Arezoo Rajabi , Bhaskar Ramasubramanian , Abdullah Al Maruf , Radha Poovendran

Several recent works have been dedicated to unsupervised reinforcement learning in a single environment, in which a policy is first pre-trained with unsupervised interactions, and then fine-tuned towards the optimal policy for several…

Machine Learning · Computer Science 2021-12-17 Mirco Mutti , Mattia Mancassola , Marcello Restelli

In practice, there are often explicit constraints on what representations or decisions are acceptable in an application of machine learning. For example it may be a legal requirement that a decision must not favour a particular group.…

Machine Learning · Computer Science 2016-03-09 Harrison Edwards , Amos Storkey

We focus on the problem of imitation learning from visual observations, where the learning agent has access to videos of experts as its sole learning source. The challenges of this framework include the absence of expert actions and the…

Machine Learning · Computer Science 2024-05-27 Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Self-interested individuals often fail to cooperate, posing a fundamental challenge for multi-agent learning. How can we achieve cooperation among self-interested, independent learning agents? Promising recent work has shown that in certain…

Imitation learning has unlocked the potential for robots to exhibit highly dexterous behaviours. However, it still struggles with long-horizon, multi-object tasks due to poor sample efficiency and limited generalisation. Existing methods…

Robotics · Computer Science 2025-09-05 Krishan Rana , Jad Abou-Chakra , Sourav Garg , Robert Lee , Ian Reid , Niko Suenderhauf

Given a dataset of expert agent interactions with an environment of interest, a viable method to extract an effective agent policy is to estimate the maximum likelihood policy indicated by this data. This approach is commonly referred to as…

Machine Learning · Computer Science 2022-11-09 Eddy Hudson , Ishan Durugkar , Garrett Warnell , Peter Stone

This paper aims to improve privacy-preserving visual recognition, an increasingly demanded feature in smart camera applications, by formulating a unique adversarial training framework. The proposed framework explicitly learns a degradation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Zhenyu Wu , Zhangyang Wang , Zhaowen Wang , Hailin Jin

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

Machine Learning · Computer Science 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher