English
Related papers

Related papers: Interval Neural Networks as Instability Detectors …

200 papers

Deep neural networks (DNNs) are becoming more prevalent in important safety-critical applications, where reliability in the prediction is paramount. Despite their exceptional prediction capabilities, current DNNs do not have an implicit…

Machine Learning · Computer Science 2021-05-14 David Betancourt , Rafi Muhanna

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Recurrent models are a popular choice for video enhancement tasks such as video denoising or super-resolution. In this work, we focus on their stability as dynamical systems and show that they tend to fail catastrophically at inference time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Thomas Tanay , Aivar Sootla , Matteo Maggioni , Puneet K. Dokania , Philip Torr , Ales Leonardis , Gregory Slabaugh

Deep learning research has recently witnessed an impressively fast-paced progress in a wide range of tasks including computer vision, natural language processing, and reinforcement learning. The extraordinary performance of these systems…

Machine Learning · Computer Science 2021-08-17 Amartya Sanyal

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

In this paper, we leverage predictive uncertainty of deep neural networks to answer challenging questions material scientists usually encounter in machine learning based materials applications workflows. First, we show that by leveraging…

Materials Science · Physics 2021-04-26 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

Machine Learning · Computer Science 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

State-of-the-art deep neural networks have achieved impressive results on many image classification tasks. However, these same architectures have been shown to be unstable to small, well sought, perturbations of the images. Despite the…

Machine Learning · Computer Science 2016-08-30 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Pascal Frossard

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

Machine Learning · Computer Science 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

Bringing deep neural networks (DNNs) into safety critical applications such as automated driving, medical imaging and finance, requires a thorough treatment of the model's uncertainties. Training deep neural networks is already resource…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Julian Burghoff , Robin Chan , Hanno Gottschalk , Annika Muetze , Tobias Riedlinger , Matthias Rottmann , Marius Schubert

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and…

Materials Science · Physics 2021-05-26 Keith T. Butler , Manh Duc Le , Jeyarajan Thiyagalingam , Toby G. Perring

The use of deep learning for medical imaging has seen tremendous growth in the research community. One reason for the slow uptake of these systems in the clinical setting is that they are complex, opaque and tend to fail silently. Outside…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Terrance DeVries , Graham W. Taylor

Reliable MRI is crucial for accurate interpretation in therapeutic and diagnostic tasks. However, undersampling during MRI acquisition as well as the overparameterized and non-transparent nature of deep learning (DL) leaves substantial…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Vineet Edupuganti , Morteza Mardani , Shreyas Vasanawala , John Pauly

Recent work introduced the epinet as a new approach to uncertainty modeling in deep learning. An epinet is a small neural network added to traditional neural networks, which, together, can produce predictive distributions. In particular,…

Machine Learning · Computer Science 2022-07-04 Xiuyuan Lu , Ian Osband , Seyed Mohammad Asghari , Sven Gowal , Vikranth Dwaracherla , Zheng Wen , Benjamin Van Roy

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

Tomographic image reconstruction with deep learning is an emerging field, but a recent landmark study reveals that several deep reconstruction networks are unstable for computed tomography (CT) and magnetic resonance imaging (MRI).…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Weiwen Wu , Dianlin Hu , Wenxiang Cong , Hongming Shan , Shaoyu Wang , Chuang Niu , Pingkun Yan , Hengyong Yu , Varut Vardhanabhuti , Ge Wang

Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Davis Gilton , Gregory Ongie , Rebecca Willett

Recent studies have shown that deep convolutional neural networks (DCNN) are vulnerable to adversarial examples and sensitive to perceptual quality as well as the acquisition condition of images. These findings raise a big concern for the…

Machine Learning · Computer Science 2020-04-15 Yeli Feng , Yiyu Cai

Deep neural networks (DNN) have achieved unprecedented performance in computer-vision tasks almost ubiquitously in business, technology, and science. While substantial efforts are made to engineer highly accurate architectures and provide…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Sumedha Singla