English
Related papers

Related papers: Enhancing Robust Fairness via Confusional Spectral…

200 papers

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

Machine Learning · Computer Science 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Flat regions of the neural network loss landscape have long been hypothesized to correlate with better generalization properties. A closely related but distinct problem is training models that are robust to internal perturbations to their…

Machine Learning · Computer Science 2026-02-10 Philip Jacobson , Ben Feinberg , Suhas Kumar , Sapan Agarwal , T. Patrick Xiao , Christopher Bennett

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

Machine Learning · Computer Science 2019-07-30 Kaiwen Wu , Yaoliang Yu

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

The idea of robustness is central and critical to modern statistical analysis. However, despite the recent advances of deep neural networks (DNNs), many studies have shown that DNNs are vulnerable to adversarial attacks. Making…

Cryptography and Security · Computer Science 2023-06-02 Jungeum Kim , Xiao Wang

In the past five years, deep learning methods have become state-of-the-art in solving various inverse problems. Before such approaches can find application in safety-critical fields, a verification of their reliability appears mandatory.…

Machine Learning · Computer Science 2023-01-18 Martin Genzel , Jan Macdonald , Maximilian März

While neural network binary classifiers are often evaluated on metrics such as Accuracy and $F_1$-Score, they are commonly trained with a cross-entropy objective. How can this training-evaluation gap be addressed? While specific techniques…

Machine Learning · Computer Science 2022-06-03 Nathan Tsoi , Kate Candon , Deyuan Li , Yofti Milkessa , Marynel Vázquez

Recurrent Neural networks (RNN) have shown promising potential for learning dynamics of sequential data. However, artificial neural networks are known to exhibit poor robustness in presence of input noise, where the sequential architecture…

Machine Learning · Computer Science 2021-05-05 Arash Amini , Guangyi Liu , Nader Motee

Although prior work in computer vision has shown strong correlations between in-distribution (ID) and out-of-distribution (OOD) accuracies, such relationships remain underexplored in audio-based models. In this study, we investigate how…

Machine Learning · Computer Science 2025-08-01 Anaïs Baranger , Lucas Maison

Supervised classification methods often assume that evaluation data is drawn from the same distribution as training data and that all classes are present for training. However, real-world classifiers must handle inputs that are far from the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Ryne Roady , Tyler L. Hayes , Christopher Kanan

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Randomized smoothing (RS) has successfully been used to improve the robustness of predictions for deep neural networks (DNNs) by adding random noise to create multiple variations of an input, followed by deciding the consensus. To…

Machine Learning · Computer Science 2024-04-29 Emmanouil Seferis , Stefanos Kollias , Chih-Hong Cheng

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

Machine Learning · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

Batch Normalization (BN) is a commonly used technique to accelerate and stabilize training of deep neural networks. Despite its empirical success, a full theoretical understanding of BN is yet to be developed. In this work, we analyze BN…

Machine Learning · Computer Science 2022-03-22 Tolga Ergen , Arda Sahiner , Batu Ozturkler , John Pauly , Morteza Mardani , Mert Pilanci

With a goal of understanding what drives generalization in deep networks, we consider several recently suggested explanations, including norm-based control, sharpness and robustness. We study how these measures can ensure generalization,…

Machine Learning · Computer Science 2017-07-07 Behnam Neyshabur , Srinadh Bhojanapalli , David McAllester , Nathan Srebro

Accurate probabilistic predictions are essential for optimal decision making. While neural network miscalibration has been studied primarily in classification, we investigate this in the less-explored domain of regression. We conduct the…

Machine Learning · Computer Science 2023-06-08 Victor Dheur , Souhaib Ben Taieb

Deep-learning models for traffic data prediction can have superior performance in modeling complex functions using a multi-layer architecture. However, a major drawback of these approaches is that most of these approaches do not offer…

Machine Learning · Computer Science 2024-07-04 Agnimitra Sengupta , Sudeepta Mondal , Adway Das , S. Ilgin Guler