English
Related papers

Related papers: Robustness Testing of Black-Box Models Against CT …

200 papers

We revisit language bottleneck models as an approach to ensuring the explainability of deep learning models for image classification. Because of inevitable information loss incurred in the step of converting images into language, the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Honori Udo , Takafumi Koshinaka

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xin Ke , ZiFeng Wang , Chunxi Li

This study investigates the robustness of image classifiers to text-guided corruptions. We utilize diffusion models to edit images to different domains. Unlike other works that use synthetic or hand-picked data for benchmarking, we use…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Mohammadreza Mofayezi , Yasamin Medghalchi

Semantic Image Segmentation facilitates a multitude of real-world applications ranging from autonomous driving over industrial process supervision to vision aids for human beings. These models are usually trained in a supervised fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Volker Knauthe , Arne Rak , Tristan Wirth , Thomas Pöllabauer , Simon Metzler , Arjan Kuijper , Dieter W. Fellner

When designing a semantic segmentation module for a practical application, such as autonomous driving, it is crucial to understand the robustness of the module with respect to a wide range of image corruptions. While there are recent…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Christoph Kamann , Carsten Rother

The advent of Vision-Language Models (VLMs) in medical image analysis has the potential to help process multimodal inputs and increase performance over traditional inference methods. However, when considering the domain in which these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sparsh Bansal , Mingyang Wu , Xin Wang , Shu Hu

Robustness studies of black-box models is recognized as a necessary task for numerical models based on structural equations and predictive models learned from data. These studies must assess the model's robustness to possible…

Optimization and Control · Mathematics 2022-09-26 Marouane Il Idrissi , Nicolas Bousquet , Fabrice Gamboa , Bertrand Iooss , Jean-Michel Loubes

In safety-critical deep learning applications, robustness measures the ability of neural models that handle imperceptible perturbations in input data, which may lead to potential safety hazards. Existing pre-deployment robustness assessment…

Machine Learning · Computer Science 2025-08-27 Wenchuan Mu , Kwan Hui Lim

Despite the recent improvements in overall accuracy, deep learning systems still exhibit low levels of robustness. Detecting possible failures is critical for a successful clinical integration of these systems, where each data point…

Image and Video Processing · Electrical Eng. & Systems 2019-10-14 Alain Jungo , Mauricio Reyes

The growing use of Machine Learning (ML) tools comes with critical challenges, such as limited model explainability. We propose a global explainability framework that leverages Optimal Transport and Distributionally Robust Optimization to…

Machine Learning · Computer Science 2026-04-23 Adriana Laurindo Monteiro , Jean-Michel Loubes

When applying a Deep Learning model to medical images, it is crucial to estimate the model uncertainty. Voxel-wise uncertainty is a useful visual marker for human experts and could be used to improve the model's voxel-wise output, such as…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

As a research community, we are still lacking a systematic understanding of the progress on adversarial robustness which often makes it hard to identify the most promising ideas in training robust models. A key challenge in benchmarking…

Parameter-efficient tuning (PET) techniques calibrate the model's predictions on downstream tasks by freezing the pre-trained models and introducing a small number of learnable parameters. However, despite the numerous PET methods proposed,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jiacheng Ruan , Xian Gao , Suncheng Xiang , Mingye Xie , Ting Liu , Yuzhuo Fu

As deep learning models continue to advance and are increasingly utilized in real-world systems, the issue of robustness remains a major challenge. Existing certified training methods produce models that achieve high provable robustness…

Machine Learning · Computer Science 2023-07-26 Zhakshylyk Nurlanov , Frank R. Schmidt , Florian Bernard

Deep Learning NLP domain lacks procedures for the analysis of model robustness. In this paper we propose a framework which validates robustness of any Question Answering model through model explainers. We propose that a robust model should…

Computation and Language · Computer Science 2018-12-07 Barbara Rychalska , Dominika Basaj , Przemyslaw Biecek

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution…

Machine Learning · Computer Science 2022-10-12 Marvin Zhang , Sergey Levine , Chelsea Finn

Deep neural networks (DNNs) have found widespread applications in interpreting remote sensing (RS) imagery. However, it has been demonstrated in previous works that DNNs are vulnerable to different types of noises, particularly adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Shaohui Mei , Jiawei Lian , Xiaofei Wang , Yuru Su , Mingyang Ma , Lap-Pui Chau

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen