English
Related papers

Related papers: Evaluating Robustness of Predictive Uncertainty Es…

200 papers

Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model. Several works suggest this variability is negligible when models have the same performance, which in the case…

Machine Learning · Statistics 2023-10-03 Sinjini Banerjee , Reilly Cannon , Tim Marrinan , Tony Chiang , Anand D. Sarwate

Improving the accuracy of deep neural networks (DNNs) on out-of-distribution (OOD) data is critical to an acceptance of deep learning (DL) in real world applications. It has been observed that accuracies on in-distribution (ID) versus OOD…

Machine Learning · Computer Science 2022-07-12 Sara Fridovich-Keil , Brian R. Bartoldson , James Diffenderfer , Bhavya Kailkhura , Peer-Timo Bremer

Reliable and robust evaluation methods are a necessary first step towards developing machine learning models that are themselves robust and reliable. Unfortunately, current evaluation protocols typically used to assess classifiers fail to…

Machine Learning · Computer Science 2025-05-26 Michael W. Spratling

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

Machine Learning · Computer Science 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised…

Machine Learning · Statistics 2020-06-11 Jay Heo , Hae Beom Lee , Saehoon Kim , Juho Lee , Kwang Joon Kim , Eunho Yang , Sung Ju Hwang

Deep learning has shown tremendous progress in a wide range of digital pathology and medical image classification tasks. Its integration into safe clinical decision-making support requires robust and reliable models. However, real-world…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Abdur R. Fayjie , Jutika Borah , Florencia Carbone , Jan Tack , Patrick Vandewalle

A fundamental question in adversarial machine learning is whether a robust classifier exists for a given task. A line of research has made some progress towards this goal by studying the concentration of measure, but we argue standard…

Machine Learning · Computer Science 2022-03-18 Xiao Zhang , David Evans

Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively…

Machine Learning · Computer Science 2024-02-20 Yunjuan Wang , Hussein Hazimeh , Natalia Ponomareva , Alexey Kurakin , Ibrahim Hammoud , Raman Arora

In data-based control, dissipativity can be a powerful tool for attaining stability guarantees for nonlinear systems if that dissipativity can be inferred from data. This work provides a tutorial on several existing methods for data-based…

Systems and Control · Electrical Eng. & Systems 2024-11-21 Ethan LoCicero , Alex Penne , Leila Bridgeman

State-of-the-art deep neural networks (DNNs) are highly effective at tackling many real-world tasks. However, their wide adoption in mission-critical contexts is hampered by two major weaknesses - their susceptibility to adversarial attacks…

Machine Learning · Computer Science 2022-11-17 Ofir Moshe , Gil Fidel , Ron Bitton , Asaf Shabtai

Robustness is often regarded as a critical future challenge for real-world applications, where stability is essential. However, as models often learn tasks in a similar order, we hypothesize that easier tasks will be easier regardless of…

Machine Learning · Computer Science 2026-02-04 Shir Ashury-Tahan , Ariel Gera , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen

It is highly desirable to know how uncertain a model's predictions are, especially for models that are complex and hard to understand as in deep learning. Although there has been a growing interest in using deep learning methods in…

Machine Learning · Computer Science 2024-08-28 Davood Karimi , Simon K. Warfield , Ali Gholipour

Cognitive diagnosis models have been widely used in different areas, especially intelligent education, to measure users' proficiency levels on knowledge concepts, based on which users can get personalized instructions. As the measurement is…

Computers and Society · Computer Science 2024-03-25 Fei Wang , Qi Liu , Enhong Chen , Chuanren Liu , Zhenya Huang , Jinze Wu , Shijin Wang

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

Machine Learning · Computer Science 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

Nowadays, we are more and more reliant on Deep Learning (DL) models and thus it is essential to safeguard the security of these systems. This paper explores the security issues in Deep Learning and analyses, through the use of experiments,…

Machine Learning · Computer Science 2022-04-26 Marco Marchetti , Edmond S. L. Ho

Studying the invertibility of deep neural networks (DNNs) provides a principled approach to better understand the behavior of these powerful models. Despite being a promising diagnostic tool, a consistent theory on their invertibility is…

Machine Learning · Computer Science 2018-06-28 Jens Behrmann , Sören Dittmer , Pascal Fernsel , Peter Maaß

The susceptibility of deep learning models to adversarial perturbations has stirred renewed attention in adversarial examples resulting in a number of attacks. However, most of these attacks fail to encompass a large spectrum of adversarial…

The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied on adversarial…

Cryptography and Security · Computer Science 2024-11-19 Ping Guo , Cheng Gong , Xi Lin , Zhiyuan Yang , Qingfu Zhang

We consider a network design and expansion problem, where we need to make a capacity investment now, such that uncertain future demand can be satisfied as closely as possible. To use a robust optimization approach, we need to construct an…

Optimization and Control · Mathematics 2021-03-03 Francis Garuba , Marc Goerigk , Peter Jacko