English
Related papers

Related papers: Robust Perception through Equivariance

200 papers

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

Human visual systems are robust to a wide range of image transformations that are challenging for artificial networks. We present the first study of image model robustness to the minute transformations found across video frames, which we…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Keren Gu , Brandon Yang , Jiquan Ngiam , Quoc Le , Jonathon Shlens

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

Optimization and Control · Mathematics 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

Recent studies have shown that Convolutional Neural Networks (CNNs) are vulnerable to a small perturbation of input called "adversarial examples". In this work, we propose a new feedforward CNN that improves robustness in the presence of…

Machine Learning · Computer Science 2016-02-26 Jonghoon Jin , Aysegul Dundar , Eugenio Culurciello

Deep neural networks are vulnerable to adversarial attacks, which can fool them by adding minuscule perturbations to the input images. The robustness of existing defenses suffers greatly under white-box attack settings, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Aamir Mustafa , Salman Khan , Munawar Hayat , Roland Goecke , Jianbing Shen , Ling Shao

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Recent research has made the surprising finding that state-of-the-art deep learning models sometimes fail to generalize to small variations of the input. Adversarial training has been shown to be an effective approach to overcome this…

Machine Learning · Computer Science 2020-03-26 Sven Gowal , Chongli Qin , Po-Sen Huang , Taylan Cemgil , Krishnamurthy Dvijotham , Timothy Mann , Pushmeet Kohli

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Background: When using deep learning models, there are many possible vulnerabilities and some of the most worrying are the adversarial inputs, which can cause wrong decisions with minor perturbations. Therefore, it becomes necessary to…

Software Engineering · Computer Science 2024-01-12 Francisco Durán López , Silverio Martínez-Fernández , Michael Felderer , Xavier Franch

Deep neural networks (DNNs) often face challenges due to their vulnerability to various adversarial perturbations, including false perturbations that undermine prediction accuracy and biased perturbations that cause biased predictions for…

Machine Learning · Computer Science 2023-10-10 Xuran Li , Peng Wu , Kaixiang Dong , Zhen Zhang , Yanting Chen

Deep neural networks are vulnerable to adversarial attacks. The literature is rich with algorithms that can easily craft successful adversarial examples. In contrast, the performance of defense techniques still lags behind. This paper…

Machine Learning · Computer Science 2019-05-29 Yuzhe Yang , Guo Zhang , Dina Katabi , Zhi Xu

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

Machine Learning · Computer Science 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

Recent work introduced the epinet as a new approach to uncertainty modeling in deep learning. An epinet is a small neural network added to traditional neural networks, which, together, can produce predictive distributions. In particular,…

Machine Learning · Computer Science 2022-07-04 Xiuyuan Lu , Ian Osband , Seyed Mohammad Asghari , Sven Gowal , Vikranth Dwaracherla , Zheng Wen , Benjamin Van Roy

We present a method for converting denoising neural networks from spatial into spatio-temporal ones by modifying the network architecture and loss function. We insert Robust Average blocks at arbitrary depths in the network graph. Each…

Graphics · Computer Science 2025-04-21 Javor Kalojanov , Kimball Thurston