中文
相关论文

相关论文: Revisiting Batch Normalization for Improving Corru…

200 篇论文

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

Algorithmic robust statistics has traditionally focused on the contamination model where a small fraction of the samples are arbitrarily corrupted. We consider a recent contamination model that combines two kinds of corruptions: (i) small…

数据结构与算法 · 计算机科学 2024-10-23 Thanasis Pittas , Ankit Pensia

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

We study the problem of robust mean estimation and introduce a novel Hamming distance-based measure of distribution shift for coordinate-level corruptions. We show that this measure yields adversary models that capture more realistic…

机器学习 · 计算机科学 2021-06-14 Zifan Liu , Jongho Park , Theodoros Rekatsinas , Christos Tzamos

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

Deep Neural Networks (DNNs) have begun to thrive in the field of automation systems, owing to the recent advancements in standardising various aspects such as architecture, optimization techniques, and regularization. In this paper, we take…

机器学习 · 计算机科学 2019-07-10 Anand Krishnamoorthy Subramanian , Nak Young Chong

While convolutional neural networks (CNNs) excel at clean image classification, they struggle to classify images corrupted with different common corruptions, limiting their real-world applicability. Recent work has shown that incorporating…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Lucas Piper , Arlindo L. Oliveira , Tiago Marques

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

机器学习 · 计算机科学 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang

Deep convolutional networks often append additive constant ("bias") terms to their convolution operations, enabling a richer repertoire of functional mappings. Biases are also used to facilitate training, by subtracting mean response over…

图像与视频处理 · 电气工程与系统科学 2020-02-11 Sreyas Mohan , Zahra Kadkhodaie , Eero P. Simoncelli , Carlos Fernandez-Granda

By default neural networks are not robust to changes in data distribution. This has been demonstrated with simple image corruptions, such as blurring or adding noise, degrading image classification performance. Many methods have been…

机器学习 · 计算机科学 2023-06-16 Ian Mason , Anirban Sarkar , Tomotake Sasaki , Xavier Boix

This paper proposes a training data augmentation pipeline that combines synthetic image data with neural style transfer in order to address the vulnerability of deep vision models to common corruptions. We show that although applying style…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Georg Siedel , Rojan Regmi , Abhirami Anand , Weijia Shao , Silvia Vock , Andrey Morozov

We define a broader family of corruption processes that generalizes previously known diffusion models. To reverse these general diffusions, we propose a new objective called Soft Score Matching that provably learns the score function for…

计算机视觉与模式识别 · 计算机科学 2022-10-06 Giannis Daras , Mauricio Delbracio , Hossein Talebi , Alexandros G. Dimakis , Peyman Milanfar

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

机器学习 · 计算机科学 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

As clean ImageNet accuracy nears its ceiling, the research community is increasingly more concerned about robust accuracy under distributional shifts. While a variety of methods have been proposed to robustify neural networks, these…

计算机视觉与模式识别 · 计算机科学 2022-04-11 Yutaro Yamada , Mayu Otani

Standard benchmarks for optical flow, scene flow, and stereo vision algorithms generally focus on model accuracy rather than robustness to image corruptions like noise or rain. Hence, the resilience of models to such real-world…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Victor Oei , Jenny Schmalfuss , Lukas Mehl , Madlen Bartsch , Shashank Agnihotri , Margret Keuper , Andreas Bulling , Andrés Bruhn

Batch Normalization (BN) uses mini-batch statistics to normalize the activations during training, introducing dependence between mini-batch elements. This dependency can hurt the performance if the mini-batch size is too small, or if the…

机器学习 · 计算机科学 2020-04-02 Saurabh Singh , Shankar Krishnan

Existing deep neural networks, say for image classification, have been shown to be vulnerable to adversarial images that can cause a DNN misclassification, without any perceptible change to an image. In this work, we propose shock absorbing…

机器学习 · 计算机科学 2019-09-19 Kevin Eykholt , Swati Gupta , Atul Prakash , Amir Rahmati , Pratik Vaishnavi , Haizhong Zheng

Object detection through LiDAR-based point cloud has recently been important in autonomous driving. Although achieving high accuracy on public benchmarks, the state-of-the-art detectors may still go wrong and cause a heavy loss due to the…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Shuangzhi Li , Zhijie Wang , Felix Juefei-Xu , Qing Guo , Xingyu Li , Lei Ma

Deep learning (DL) has surpassed human performance on standard benchmarks, driving its widespread adoption in computer vision tasks. One such task is disparity estimation, estimating the disparity between matching pixels in stereo image…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Shashank Agnihotri , Amaan Ansari , Annika Dackermann , Fabian Rösch , Margret Keuper