English
Related papers

Related papers: Assessing Robustness of Machine Learning Models us…

200 papers

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

Machine Learning · Computer Science 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

Linguistic representation learning in deep neural language models (LMs) has been studied for decades, for both practical and theoretical reasons. However, finding representations in LMs remains an unsolved problem, in part due to a dilemma…

Computation and Language · Computer Science 2026-03-26 Joshua Rozner , Cory Shain

Adversarial examples have appeared as a ubiquitous property of machine learning models where bounded adversarial perturbation could mislead the models to make arbitrarily incorrect predictions. Such examples provide a way to assess the…

Machine Learning · Computer Science 2021-03-02 Zhuolin Yang , Zhaoxi Chen , Tiffany Cai , Xinyun Chen , Bo Li , Yuandong Tian

Voltage stability in modern power systems involves coupled dynamics across multiple time scales. Conventional methods based on time-scale separation or static stability margins may overlook instabilities caused by the coupling of slow and…

Systems and Control · Electrical Eng. & Systems 2026-02-17 Naoki Hashima , Hikaru Hoshino , Luis David Pabón Ospina , Eiko Furutani

Based on existing ideas in the field of imprecise probabilities, we present a new approach for assessing the reliability of the individual predictions of a generative probabilistic classifier. We call this approach robustness…

Machine Learning · Computer Science 2025-04-11 Adrián Detavernier , Jasper De Bock

Clinical machine learning applications are often plagued with confounders that can impact the generalizability and predictive performance of the learners. Confounding is especially problematic in remote digital health studies where the…

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation and hallucination detection, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear…

Computation and Language · Computer Science 2026-04-14 Joe Stacey , Hadas Orgad , Kentaro Inui , Benjamin Heinzerling , Nafise Sadat Moosavi

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are…

Machine Learning · Computer Science 2025-02-17 Tommaso Baldi , Javier Campos , Olivia Weng , Caleb Geniesse , Nhan Tran , Ryan Kastner , Alessandro Biondi

The success of neural networks across most machine learning tasks and the persistence of adversarial examples have made the verification of such models an important quest. Several techniques have been successfully developed to verify…

Machine Learning · Computer Science 2019-10-14 Nathanaël Fijalkow , Mohit Kumar Gupta

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

The perturbation analysis of linear solvers applied to systems arising broadly in machine learning settings -- for instance, when using linear regression models -- establishes an important perspective when reframing these analyses through…

Machine Learning · Computer Science 2024-10-02 Yixin Liu , Arielle Carr , Lichao Sun

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the…

Machine Learning · Computer Science 2023-11-28 Svetlana Pavlitska , Hannes Grolig , J. Marius Zöllner

Machine-learning models are known to be vulnerable to evasion attacks that perturb model inputs to induce misclassifications. In this work, we identify real-world scenarios where the true threat cannot be assessed accurately by existing…

Machine Learning · Computer Science 2024-03-12 Weiran Lin , Keane Lucas , Neo Eyal , Lujo Bauer , Michael K. Reiter , Mahmood Sharif

We study the robustness of system estimation to parametric perturbations in system dynamics and initial conditions. We define the problem of sensitivity-based parametric uncertainty quantification in dynamical system estimation. The main…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ayush Pandey

We provide a framework for incorporating robustness -- to perturbations in the transition dynamics which we refer to as model misspecification -- into continuous control Reinforcement Learning (RL) algorithms. We specifically focus on…

Time series forecasting is an important and forefront task in many real-world applications. However, most of time series forecasting techniques assume that the training data is clean without anomalies. This assumption is unrealistic since…

Machine Learning · Computer Science 2024-02-06 Hao Cheng , Qingsong Wen , Yang Liu , Liang Sun

Deep learning (DL) has been applied extensively in a wide range of fields. However, it has been shown that DL models are susceptible to a certain kinds of perturbations called \emph{adversarial attacks}. To fully unlock the power of DL in…

Statistical Finance · Quantitative Finance 2020-06-09 Jun-Hao Chen , Samuel Yen-Chi Chen , Yun-Cheng Tsai , Chih-Shiang Shur

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

Methodology · Statistics 2023-04-07 Matias Salibian-Barrera