English
Related papers

Related papers: Provable Robust Saliency-based Explanations

200 papers

We consider the problem of retraining machine learning (ML) models when new batches of data become available. Existing approaches greedily optimize for predictive power independently at each batch, without considering the stability of the…

Machine Learning · Computer Science 2025-02-05 Dimitris Bertsimas , Vassilis Digalakis , Yu Ma , Phevos Paschalidis

Stability selection is a widely adopted resampling-based framework for high-dimensional variable selection. This paper seeks to broaden the use of an established stability estimator to evaluate the overall stability of the stability…

Methodology · Statistics 2025-06-04 Mahdi Nouraie , Samuel Muller

There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the…

Machine Learning · Statistics 2024-03-19 Faisal Hamman , Erfaun Noorani , Saumitra Mishra , Daniele Magazzeni , Sanghamitra Dutta

Stability of recurrent models is closely linked with trainability, generalizability and in some applications, safety. Methods that train stable recurrent neural networks, however, do so at a significant cost to expressibility. We propose an…

Machine Learning · Computer Science 2019-12-24 Max Revay , Ian R. Manchester

A growing line of work has investigated the development of neural NLP models that can produce rationales--subsets of input that can explain their model predictions. In this paper, we ask whether such rationale models can also provide…

Computation and Language · Computer Science 2022-05-05 Howard Chen , Jacqueline He , Karthik Narasimhan , Danqi Chen

A small but growing body of work has shown that machine learning models which better align with human vision have also exhibited higher robustness to adversarial examples, raising the question: can human-like perception make models more…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Blaine Hoak , Kunyang Li , Patrick McDaniel

We show that there may exist an inherent tension between the goal of adversarial robustness and that of standard generalization. Specifically, training robust models may not only be more resource-consuming, but also lead to a reduction of…

Machine Learning · Statistics 2019-09-10 Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Alexander Turner , Aleksander Madry

Pre-trained language models (PLMs) have consistently demonstrated outstanding performance across a diverse spectrum of natural language processing tasks. Nevertheless, despite their success with unseen data, current PLM-based…

Computation and Language · Computer Science 2024-03-19 Javad Rafiei Asl , Prajwal Panzade , Eduardo Blanco , Daniel Takabi , Zhipeng Cai

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

Machine Learning · Computer Science 2023-10-04 Jiarui Yao , Simon Shaolei Du

This paper introduces recurrent equilibrium networks (RENs), a new class of nonlinear dynamical models} for applications in machine learning, system identification and control. The new model class admits ``built in'' behavioural guarantees…

Machine Learning · Computer Science 2023-07-13 Max Revay , Ruigang Wang , Ian R. Manchester

While machine-learning algorithms have demonstrated a strong ability in detecting Android malware, they can be evaded by sparse evasion attacks crafted by injecting a small set of fake components, e.g., permissions and system calls, without…

Machine Learning · Computer Science 2021-05-28 Marco Melis , Michele Scalas , Ambra Demontis , Davide Maiorca , Battista Biggio , Giorgio Giacinto , Fabio Roli

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Model averaging has received much attention in the past two decades, which integrates available information by averaging over potential models. Although various model averaging methods have been developed, there are few literatures on the…

Machine Learning · Statistics 2023-11-27 Hengkun Zhu , Guohua Zou

Users of program analyses expect that results change predictably in response to changes in their programs, but many analyses fail to provide such robustness. This paper introduces a theoretical framework that provides a unified language to…

Programming Languages · Computer Science 2026-04-14 Zachary Kincaid , Shaowei Zhu

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

Machine Learning · Statistics 2026-02-20 Yiyao Yang

We study a class of constrained reinforcement learning (RL) problems in which multiple constraint specifications are not identified before training. It is challenging to identify appropriate constraint specifications due to the undefined…

Optimization and Control · Mathematics 2024-01-02 Dongsheng Ding , Zhengyan Huan , Alejandro Ribeiro

Existing NLP datasets contain various biases, and models tend to quickly learn those biases, which in turn limits their robustness. Existing approaches to improve robustness against dataset biases mostly focus on changing the training…

Computation and Language · Computer Science 2020-10-26 Nafise Sadat Moosavi , Marcel de Boer , Prasetya Ajie Utama , Iryna Gurevych

While deep learning has significantly advanced accident anticipation, the robustness of these safety-critical systems against real-world perturbations remains a major challenge. We reveal that state-of-the-art models like CRASH, despite…

Machine Learning · Computer Science 2026-04-03 Wenjing Wang , Wenxuan Wang , Songning Lai

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation and hallucination detection, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear…

Computation and Language · Computer Science 2026-04-14 Joe Stacey , Hadas Orgad , Kentaro Inui , Benjamin Heinzerling , Nafise Sadat Moosavi