English
Related papers

Related papers: Interpretable, calibrated neural networks for anal…

200 papers

The study of structure-spectrum relationships is essential for spectral interpretation, impacting structural elucidation and material design. Predicting spectra from molecular structures is challenging due to their complex relationships.…

Computational Physics · Physics 2024-08-29 Fanjie Xu , Wentao Guo , Feng Wang , Lin Yao , Hongshuai Wang , Fujie Tang , Zhifeng Gao , Linfeng Zhang , Weinan E , Zhong-Qun Tian , Jun Cheng

We study the quantification of uncertainty of Convolutional Neural Networks (CNNs) based on gradient metrics. Unlike the classical softmax entropy, such metrics gather information from all layers of the CNN. We show for the EMNIST digits…

Machine Learning · Computer Science 2018-07-27 Philipp Oberdiek , Matthias Rottmann , Hanno Gottschalk

Learning deep representations to solve complex machine learning tasks has become the prominent trend in the past few years. Indeed, Deep Neural Networks are now the golden standard in domains as various as computer vision, natural language…

Machine Learning · Computer Science 2020-12-04 Vincent Gripon , Carlos Lassance , Ghouthi Boukli Hacene

To improve the uncertainty quantification of variance networks, we propose a novel tree-structured local neural network model that partitions the feature space into multiple regions based on uncertainty heterogeneity. A tree is built upon…

Machine Learning · Computer Science 2023-07-21 Wenxuan Ma , Xing Yan , Kun Zhang

Advances in deep neural network (DNN) based molecular property prediction have recently led to the development of models of remarkable accuracy and generalization ability, with graph convolution neural networks (GCNNs) reporting…

Machine Learning · Computer Science 2019-10-09 Gabriele Scalia , Colin A. Grambow , Barbara Pernici , Yi-Pei Li , William H. Green

This paper addresses the problem of modeling and estimating dynamic multi-valued mappings. While most mathematical models provide a unique solution for a given input, real-world applications often lack deterministic solutions. In such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Geng Li , Di Qiu , Lok Ming Lui

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

Machine Learning · Computer Science 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Theoretical understanding of deep learning is one of the most important tasks facing the statistics and machine learning communities. While deep neural networks (DNNs) originated as engineering methods and models of biological networks in…

Machine Learning · Statistics 2018-06-04 Adam S. Charles

Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling…

Machine Learning · Computer Science 2021-11-04 Jonas Busk , Peter Bjørn Jørgensen , Arghya Bhowmik , Mikkel N. Schmidt , Ole Winther , Tejs Vegge

This paper introduces a Deep Scattering network that utilizes Dual-Tree complex wavelets to extract translation invariant representations from an input signal. The computationally efficient Dual-Tree wavelets decompose the input signal into…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Amarjot Singh , Nick Kingsbury

The last decade of machine learning has seen drastic increases in scale and capabilities. Deep neural networks (DNNs) are increasingly being deployed in the real world. However, they are difficult to analyze, raising concerns about using…

Machine Learning · Computer Science 2023-08-22 Tilman Räuker , Anson Ho , Stephen Casper , Dylan Hadfield-Menell

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

Deep learning methods have established a significant place in image classification. While prior research has focused on enhancing final outcomes, the opaque nature of the decision-making process in these models remains a concern for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Elmira Mousa Rezabeyk , Salar Beigzad , Yasin Hamzavi , Mohsen Bagheritabar , Seyedeh Sogol Mirikhoozani

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

Deep neural networks (NNs) are known to lack uncertainty estimates and struggle to incorporate new data. We present a method that mitigates these issues by converting NNs from weight space to function space, via a dual parameterization.…

Machine Learning · Statistics 2023-09-06 Aidan Scannell , Riccardo Mereu , Paul Chang , Ella Tamir , Joni Pajarinen , Arno Solin

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Deep neural networks (DNNs) with high expressiveness have achieved state-of-the-art performance in many tasks. However, their distributed feature representations are difficult to interpret semantically. In this work, human-interpretable…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jindong Gu , Volker Tresp

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman