English
Related papers

Related papers: An Adversarial Objective for Scalable Exploration

200 papers

We consider the problem of third-person imitation learning with the additional challenge that the learner must select the perspective from which they observe the expert. In our setting, each perspective provides only limited information…

Machine Learning · Computer Science 2023-12-29 Timo Klein , Susanna Weinberger , Adish Singla , Sebastian Tschiatschek

Exploration policies in Bayesian bandits maximize the average reward over problem instances drawn from some distribution $\mathcal{P}$. In this work, we learn such policies for an unknown distribution $\mathcal{P}$ using samples from…

Machine Learning · Computer Science 2020-06-11 Craig Boutilier , Chih-Wei Hsu , Branislav Kveton , Martin Mladenov , Csaba Szepesvari , Manzil Zaheer

Unlike traditional learning to rank models that depend on hand-crafted features, neural representation learning models learn higher level features for the ranking task by training on large datasets. Their ability to learn new features…

Information Retrieval · Computer Science 2018-05-10 Daniel Cohen , Bhaskar Mitra , Katja Hofmann , W. Bruce Croft

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

Adversarial machine learning concerns situations in which learners face attacks from active adversaries. Such scenarios arise in applications such as spam email filtering, malware detection and fake-image generation, where security methods…

Machine Learning · Computer Science 2024-10-29 David Benfield , Stefano Coniglio , Martin Kunc , Phan Tu Vuong , Alain Zemkoho

Two-sided matching markets have long existed to pair agents in the absence of regulated exchanges. A common example is school choice, where a matching mechanism uses student and school preferences to assign students to schools. In such…

Machine Learning · Computer Science 2021-09-17 Stefania Ionescu , Yuhao Du , Kenneth Joseph , Anikó Hannák

Exploration is a difficult challenge in reinforcement learning and even recent state-of-the art curiosity-based methods rely on the simple epsilon-greedy strategy to generate novelty. We argue that pure random walks do not succeed to…

Machine Learning · Computer Science 2018-07-06 Fabio Pardo , Vitaly Levdik , Petar Kormushev

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Despite the remarkable performance and generalization levels of deep learning models in a wide range of artificial intelligence tasks, it has been demonstrated that these models can be easily fooled by the addition of imperceptible yet…

Machine Learning · Computer Science 2023-01-27 Jon Vadillo , Roberto Santana , Jose A. Lozano

Machine learning models are vulnerable to adversarial examples formed by applying small carefully chosen perturbations to inputs that cause unexpected classification errors. In this paper, we perform experiments on various adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Andras Rozsa , Manuel Günther , Terrance E. Boult

Advances in the effectiveness of machine learning models have come at the cost of enormous complexity resulting in a poor understanding of how they function. Local surrogate methods have been used to approximate the workings of these…

Machine Learning · Computer Science 2025-01-16 Christopher Burger , Charles Walter

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

Machine Learning · Computer Science 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

Machine Learning · Computer Science 2023-06-14 Omar Montasser

We investigate adversarial learning in the case when only an unnormalized form of the density can be accessed, rather than samples. With insights so garnered, adversarial learning is extended to the case for which one has access to an…

Machine Learning · Computer Science 2019-01-04 Chunyuan Li , Ke Bai , Jianqiao Li , Guoyin Wang , Changyou Chen , Lawrence Carin

Local prediction-error-based curiosity rewards focus on the current transition without considering the world model's cumulative prediction error across all visited transitions. We introduce Curiosity-Critic, which grounds its intrinsic…

Machine Learning · Computer Science 2026-04-30 Vin Bhaskara , Haicheng Wang

Adaptive exploration methods propose ways to learn complex policies via alternating between exploration and exploitation. An important question for such methods is to determine the appropriate moment to switch between exploration and…

Artificial Intelligence · Computer Science 2026-02-11 Leonidas Bakopoulos , Georgios Chalkiadakis

Approachability has become a standard tool in analyzing earning algorithms in the adversarial online learning setup. We develop a variant of approachability for games where there is ambiguity in the obtained reward that belongs to a set,…

Statistics Theory · Mathematics 2012-02-17 Shie Mannor , Vianney Perchet , Gilles Stoltz

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

Motivated by safety-critical classification problems, we investigate adversarial attacks against cost-sensitive classifiers. We use current state-of-the-art adversarially-resistant neural network classifiers [1] as the underlying models.…

Machine Learning · Statistics 2019-10-08 Gavin S. Hartnett , Andrew J. Lohn , Alexander P. Sedlack

We consider the problem of time-limited robotic exploration in previously unseen environments where exploration is limited by a predefined amount of time. We propose a novel exploration approach using learning-augmented model-based…

Robotics · Computer Science 2023-08-10 Yimeng Li , Arnab Debnath , Gregory Stein , Jana Kosecka