English
Related papers

Related papers: One neuron is more informative than a deep neural …

200 papers

Deep neural networks (DNNs) are powerful nonlinear architectures that are known to be robust to random perturbations of the input. However, these models are vulnerable to adversarial perturbations--small input changes crafted explicitly to…

Machine Learning · Statistics 2017-11-17 Reuben Feinman , Ryan R. Curtin , Saurabh Shintre , Andrew B. Gardner

Knowledge about historic landslide event occurrence is important for supporting disaster risk reduction strategies. Building upon findings from 2022 Landslide4Sense Competition, we propose a deep neural network based system for landslide…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Cam Le , Lam Pham , Jasmin Lampert , Matthias Schlögl , Alexander Schindler

The purpose of this work is the systematic comparison of the application of two artificial neural networks (ANNs) to the surrogate modeling of the stress field in materially heterogeneous periodic polycrystalline microstructures. The first…

Materials Science · Physics 2022-11-01 Sarthak Kapoor , Jaber Rezaei Mianroodi , Mohammad Khorrami , Nima S. Siboni , Bob Svendsen

Modeling of turbulent flows is still challenging. One way to deal with the large scale separation due to turbulence is to simulate only the large scales and model the unresolved contributions as done in large-eddy simulation (LES). This…

Computational Physics · Physics 2019-10-03 Mathis Bode , Michael Gauding , Konstantin Kleinheinz , Heinz Pitsch

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Neural collapse (NC) refers to the surprising structure of the last layer of deep neural networks in the terminal phase of gradient descent training. Recently, an increasing amount of experimental evidence has pointed to the propagation of…

Machine Learning · Computer Science 2023-05-23 Peter Súkeník , Marco Mondelli , Christoph Lampert

Convolutional Neural Networks (CNNs) have been proven to be extremely successful at solving computer vision tasks. State-of-the-art methods favor such deep network architectures for its accuracy performance, with the cost of having massive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jiahui Huang , Kshitij Dwivedi , Gemma Roig

It is often observed that the probabilistic predictions given by a machine learning model can disagree with averaged actual outcomes on specific subsets of data, which is also known as the issue of miscalibration. It is responsible for the…

Machine Learning · Computer Science 2020-01-28 Feiyang Pan , Xiang Ao , Pingzhong Tang , Min Lu , Dapeng Liu , Lei Xiao , Qing He

Ultra reliable low latency communications (URLLC) is a new service class introduced in 5G which is characterized by strict reliability $(1-10^{-5})$ and low latency requirements (1 ms). To meet these requisites, several strategies like…

Signal Processing · Electrical Eng. & Systems 2021-12-01 Christian Padilla , Ramin Hashemi , Nurul Huda Mahmood , Matti Latva-aho

We present a new type of probabilistic model which we call DISsimilarity COefficient Networks (DISCO Nets). DISCO Nets allow us to efficiently sample from a posterior distribution parametrised by a neural network. During training, DISCO…

Computer Vision and Pattern Recognition · Computer Science 2016-10-31 Diane Bouchacourt , M. Pawan Kumar , Sebastian Nowozin

Accurate estimation of aleatoric and epistemic uncertainty is crucial to build safe and reliable systems. Traditional approaches, such as dropout and ensemble methods, estimate uncertainty by sampling probability predictions from different…

Machine Learning · Computer Science 2020-10-23 Bertrand Charpentier , Daniel Zügner , Stephan Günnemann

Deep learning has been used in many areas, such as feature detections in images and the game of go. This paper presents a study that attempts to use the deep learning method to predict turbomachinery performance. Three different deep neural…

Machine Learning · Computer Science 2018-06-20 Cheng'an Bai , Chao Zhou

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…

To increase the trustworthiness of deep neural network (DNN) classifiers, an accurate prediction confidence that represents the true likelihood of correctness is crucial. Towards this end, many post-hoc calibration methods have been…

Machine Learning · Computer Science 2020-06-17 Zhihui Shao , Jianyi Yang , Shaolei Ren

Objectives: The purpose is to apply a previously validated deep learning algorithm to a new thyroid nodule ultrasound image dataset and compare its performances with radiologists. Methods: Prior study presented an algorithm which is able to…

Image and Video Processing · Electrical Eng. & Systems 2023-05-08 Jingxi Weng , Benjamin Wildman-Tobriner , Mateusz Buda , Jichen Yang , Lisa M. Ho , Brian C. Allen , Wendy L. Ehieli , Chad M. Miller , Jikai Zhang , Maciej A. Mazurowski

Neural collapse (NC) and its multi-layer variant, deep neural collapse (DNC), describe a structured geometry that occurs in the features and weights of trained deep networks. Recent theoretical work by Sukenik et al. using a deep…

Machine Learning · Computer Science 2025-10-07 Connall Garrod , Jonathan P. Keating

Conventional wisdom suggests that neural network predictions tend to be unpredictable and overconfident when faced with out-of-distribution (OOD) inputs. Our work reassesses this assumption for neural networks with high-dimensional inputs.…

Machine Learning · Computer Science 2024-03-19 Katie Kang , Amrith Setlur , Claire Tomlin , Sergey Levine

Despite the tremendous advances achieved over the past years by deep learning techniques, the latest risk prediction models for industrial applications still rely on highly handtuned stage-wised statistical learning tools, such as gradient…

Machine Learning · Computer Science 2023-08-08 Yancheng Liang , Jiajie Zhang , Hui Li , Xiaochen Liu , Yi Hu , Yong Wu , Jinyao Zhang , Yongyan Liu , Yi Wu

Landslides, movement of soil and rock under the influence of gravity, are common phenomena that cause significant human and economic losses every year. Experts use heterogeneous features such as slope, elevation, land cover, lithology, rock…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Ainaz Hajimoradlou , Gioachino Roberti , David Poole

This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Yiwei Fu , Samer Saab , Asok Ray , Michael Hauser