English
Related papers

Related papers: Adversarial Counterfactual Environment Model Learn…

200 papers

We propose a novel model-based offline Reinforcement Learning (RL) framework, called Adversarial Model for Offline Reinforcement Learning (ARMOR), which can robustly learn policies to improve upon an arbitrary reference policy regardless of…

Machine Learning · Computer Science 2023-12-29 Mohak Bhardwaj , Tengyang Xie , Byron Boots , Nan Jiang , Ching-An Cheng

Reinforcement learning (RL) has achieved remarkable success in fields like robotics and autonomous driving, but adversarial attacks designed to mislead RL systems remain challenging. Existing approaches often rely on modifying the…

Machine Learning · Computer Science 2025-07-25 Junyong Jiang , Buwei Tian , Chenxing Xu , Songze Li , Lu Dong

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

Machine Learning · Computer Science 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

We study counterfactual prediction under assignment bias and propose a mathematically grounded, information-theoretic approach that removes treatment-covariate dependence without adversarial training. Starting from a bound that links the…

Machine Learning · Computer Science 2026-04-28 Shiqin Tang , Rong Feng , Shuxin Zhuang , Youzhi Zhang , Hongzong Li

Machine-learning models can be fooled by adversarial examples, i.e., carefully-crafted input perturbations that force models to output wrong predictions. While uncertainty quantification has been recently proposed to detect adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Emanuele Ledda , Daniele Angioni , Giorgio Piras , Giorgio Fumera , Battista Biggio , Fabio Roli

Deep Reinforcement Learning (DRL) policies are highly susceptible to adversarial noise in observations, which poses significant risks in safety-critical scenarios. The challenge inherent to adversarial perturbations is that by altering the…

Machine Learning · Computer Science 2025-04-25 Roman Belaire , Arunesh Sinha , Pradeep Varakantham

Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing…

Machine Learning · Computer Science 2021-09-29 Philip Naumann , Eirini Ntoutsi

In recent years, fairness has become an important topic in the machine learning research community. In particular, counterfactual fairness aims at building prediction models which ensure fairness at the most individual level. Rather than…

Machine Learning · Computer Science 2020-09-01 Vincent Grari , Sylvain Lamprier , Marcin Detyniecki

We provide an approach for learning deep neural net representations of models described via conditional moment restrictions. Conditional moment restrictions are widely used, as they are the language by which social scientists describe the…

Econometrics · Economics 2018-04-25 Greg Lewis , Vasilis Syrgkanis

We propose a new model-based offline RL framework, called Adversarial Models for Offline Reinforcement Learning (ARMOR), which can robustly learn policies to improve upon an arbitrary baseline policy regardless of data coverage. Based on…

Machine Learning · Computer Science 2022-11-10 Tengyang Xie , Mohak Bhardwaj , Nan Jiang , Ching-An Cheng

As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of…

Machine Learning · Computer Science 2022-12-16 Martin Pawelczyk , Chirag Agarwal , Shalmali Joshi , Sohini Upadhyay , Himabindu Lakkaraju

Counterfactuals are a popular framework for interpreting machine learning predictions. These what if explanations are notoriously challenging to create for computer vision models: standard gradient-based methods are prone to produce…

Machine Learning · Computer Science 2025-04-23 Jeremy Goldwasser , Giles Hooker

Balanced representation learning methods have been applied successfully to counterfactual inference from observational data. However, approaches that account for survival outcomes are relatively limited. Survival data are frequently…

Machine Learning · Statistics 2021-03-04 Paidamoyo Chapfuwa , Serge Assaad , Shuxi Zeng , Michael J. Pencina , Lawrence Carin , Ricardo Henao

Adversarial training is a technique of improving model performance by involving adversarial examples in the training process. In this paper, we investigate adversarial training with multiple adversarial examples to benefit the relation…

Computation and Language · Computer Science 2020-09-28 Peng Su , K. Vijay-Shanker

Adversarial Training (AT) is known as an effective approach to enhance the robustness of deep neural networks. Recently researchers notice that robust models with AT have good generative ability and can synthesize realistic images, while…

Machine Learning · Computer Science 2022-03-28 Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

Undirected graphical models are compact representations of joint probability distributions over random variables. To solve inference tasks of interest, graphical models of arbitrary topology can be trained using empirical risk minimization.…

Machine Learning · Computer Science 2020-10-23 Adarsh K. Jeewajee , Leslie P. Kaelbling

Single-model systems often suffer from deficiencies in tasks such as speaker verification (SV) and image classification, relying heavily on partial prior knowledge during decision-making, resulting in suboptimal performance. Although…

Machine Learning · Computer Science 2024-04-25 Zuheng Kang , Yayun He , Jianzong Wang , Junqing Peng , Jing Xiao

Model-free reinforcement learning algorithms can compute policy gradients given sampled environment transitions, but require large amounts of data. In contrast, model-based methods can use the learned model to generate new data, but model…

Machine Learning · Computer Science 2022-03-04 Lukas P. Fröhlich , Maksym Lefarov , Melanie N. Zeilinger , Felix Berkenkamp

Machine Learning models are increasingly used in businesses to detect faults and anomalies in complex systems. In this work, we take this approach a step further: beyond merely detecting anomalies, we aim to identify the optimal control…

Systems and Control · Electrical Eng. & Systems 2025-07-15 Emilio Carrizosa , Martina Fischetti , Roshell Haaker , Juan Miguel Morales