English
Related papers

Related papers: Beyond Dropout: Robust Convolutional Neural Networ…

200 papers

Deep convolutional neural networks (CNNs) have brought breakthroughs in processing clinical electrocardiograms (ECGs), speaker-independent speech and complex images. However, typical CNNs require a fixed input size while it is common to…

Machine Learning · Computer Science 2022-10-07 Linpeng Jin

While modern convolutional neural networks achieve outstanding accuracy on many image classification tasks, they are, compared to humans, much more sensitive to image degradation. Here, we describe a variant of Batch Normalization,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Bojian Yin , Siebren Schaafsma , Henk Corporaal , H. Steven Scholte , Sander M. Bohte

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer

Face recognition has obtained remarkable progress in recent years due to the great improvement of deep convolutional neural networks (CNNs). However, deep CNNs are vulnerable to adversarial examples, which can cause fateful consequences in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Yinpeng Dong , Hang Su , Baoyuan Wu , Zhifeng Li , Wei Liu , Tong Zhang , Jun Zhu

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

Deep neural networks are often not robust to semantically-irrelevant changes in the input. In this work we address the issue of robustness of state-of-the-art deep convolutional neural networks (CNNs) against commonly occurring distortions…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Nikhil Kapoor , Chun Yuan , Jonas Löhdefink , Roland Zimmermann , Serin Varghese , Fabian Hüger , Nico Schmidt , Peter Schlicht , Tim Fingscheidt

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

Deep convolutional neural networks (DCNNs) have rivaled humans on many visual tasks, yet they remain vulnerable to near-imperceptible perturbations generated by adversarial attacks. Recent work shows that aligning DCNN representations with…

Neurons and Cognition · Quantitative Biology 2026-05-07 Zhenan Shao , Tianyu Ren , Chengxiao Wang , Leyla Isik , Diane M. Beck

A major area of growth within deep learning has been the study and implementation of convolutional neural networks. The general explanation within the deep learning community of the robustness of convolutional neural networks (CNNs) within…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Kian Ghodoussi , Nihar Sheth , Zane Durante , Markie Wagner

LBP is a successful hand-crafted feature descriptor in computer vision. However, in the deep learning era, deep neural networks, especially convolutional neural networks (CNNs) can automatically learn powerful task-aware features that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Zhuo Su , Matti Pietikäinen , Li Liu

The performance of single image super-resolution has achieved significant improvement by utilizing deep convolutional neural networks (CNNs). The features in deep CNN contain different types of information which make different contributions…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Yanting Hu , Jie Li , Yuanfei Huang , Xinbo Gao

Existing convolutional neural network (CNN) based face recognition algorithms typically learn a discriminative feature mapping, using a loss function that enforces separation of features from different classes and/or aggregation of features…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Luo Jiang , Juyong Zhang , Bailin Deng

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

We present Masked Frequency Modeling (MFM), a unified frequency-domain-based approach for self-supervised pre-training of visual models. Instead of randomly inserting mask tokens to the input embeddings in the spatial domain, in this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Jiahao Xie , Wei Li , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Deep learning models are intrinsically sensitive to distribution shifts in the input data. In particular, small, barely perceivable perturbations to the input data can force models to make wrong predictions with high confidence. An common…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Paul Gavrikov , Janis Keuper

Recently, convolutional neural networks (CNNs)-based facial landmark detection methods have achieved great success. However, most of existing CNN-based facial landmark detection methods have not attempted to activate multiple correlated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jun Wan , Zhihui Lai , Linlin Shen , Jie Zhou , Can Gao , Gang Xiao , Xianxu Hou

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

The field of object detection and understanding is rapidly evolving, driven by advances in both traditional CNN-based models and emerging multi-modal large language models (LLMs). While CNNs like ResNet and YOLO remain highly effective for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Nirmal Elamon , Rouzbeh Davoudi