English
Related papers

Related papers: Dual Accuracy-Quality-Driven Neural Network for Pr…

200 papers

Physics-informed neural networks (PINNs) are one popular approach to incorporate a priori knowledge about physical systems into the learning framework. PINNs are known to be robust for smaller training sets, derive better generalization…

Machine Learning · Computer Science 2024-06-19 Birgit Hillebrecht , Benjamin Unger

Deep neural networks excel at comprehending complex visual signals, delivering on par or even superior performance to that of human experts. However, ad-hoc visual explanations of model decisions often reveal an alarming level of reliance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dong Wang , Yuewei Yang , Chenyang Tao , Zhe Gan , Liqun Chen , Fanjie Kong , Ricardo Henao , Lawrence Carin

Recurrent neural networks and sequence to sequence models require a predetermined length for prediction output length. Our model addresses this by allowing the network to predict a variable length output in inference. A new loss function…

Machine Learning · Computer Science 2019-08-20 Mark Harmon , Diego Klabjan

Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an…

Machine Learning · Computer Science 2019-07-10 Hyunjik Kim , Andriy Mnih , Jonathan Schwarz , Marta Garnelo , Ali Eslami , Dan Rosenbaum , Oriol Vinyals , Yee Whye Teh

Uncertainty quantification is an important prerequisite for the deployment of deep learning models in safety-critical areas. Yet, this hinges on the uncertainty estimates being useful to the extent the prediction intervals are…

Machine Learning · Computer Science 2025-07-29 Dharmesh Tailor , Alvaro H. C. Correia , Eric Nalisnick , Christos Louizos

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Efficient time series forecasting has become critical for real-world applications, particularly with deep neural networks (DNNs). Efficiency in DNNs can be achieved through sparse connectivity and reducing the model size. However, finding…

Machine Learning · Computer Science 2024-06-13 Zahra Atashgahi , Mykola Pechenizkiy , Raymond Veldhuis , Decebal Constantin Mocanu

Deep neural network (DNN) regression models are widely used in applications requiring state-of-the-art predictive accuracy. However, until recently there has been little work on accurate uncertainty quantification for predictions from such…

Methodology · Statistics 2020-09-07 Nadja Klein , David J. Nott , Michael Stanley Smith

In this work, we develop a simple algorithm for semi-supervised regression. The key idea is to use the top eigenfunctions of integral operator derived from both labeled and unlabeled examples as the basis functions and learn the prediction…

Machine Learning · Computer Science 2012-07-03 Ming Ji , Tianbao Yang , Binbin Lin , Rong Jin , Jiawei Han

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to an ad-hoc operating point,…

Machine Learning · Computer Science 2023-10-06 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

This paper introduces Conformal Thresholded Intervals (CTI), a novel conformal regression method that aims to produce the smallest possible prediction set with guaranteed coverage. Unlike existing methods that rely on nested conformal…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

The increasing need for robustness, reliability, and determinism in wireless networks for industrial and mission-critical applications is the driver for the growth of new innovative methods. The study presented in this work makes use of…

Networking and Internet Architecture · Computer Science 2025-12-04 Gabriele Formis , Amanda Ericson , Stefan Forsstrom , Kyi Thar , Gianluca Cena , Stefano Scanzio

The problem of machine learning with missing values is common in many areas. A simple approach is to first construct a dataset without missing values simply by discarding instances with missing entries or by imputing a fixed value for each…

Machine Learning · Statistics 2018-03-02 Hiroyuki Hanada , Toshiyuki Takada , Jun Sakuma , Ichiro Takeuchi

We suggest a general approach to quantification of different forms of aleatoric uncertainty in regression tasks performed by artificial neural networks. It is based on the simultaneous training of two neural networks with a joint loss…

Machine Learning · Statistics 2018-09-05 Pavel Gurevich , Hannes Stuke

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

This paper proposes a novel kernel-based optimization scheme to handle tasks in the analysis, e.g., signal spectral estimation and single-channel source separation of 1D non-stationary oscillatory data. The key insight of our optimization…

Machine Learning · Statistics 2022-12-12 Jieren Xu , Yitong Li , Haizhao Yang , David Dunson , Ingrid Daubechies

The earth system is exceedingly complex and often chaotic in nature, making prediction incredibly challenging: we cannot expect to make perfect predictions all of the time. Instead, we look for specific states of the system that lead to…

Machine Learning · Computer Science 2022-01-05 Elizabeth A. Barnes , Randal J. Barnes

We propose a fast, non-Bayesian method for producing uncertainty scores in the output of pre-trained deep neural networks (DNNs) using a data-driven interval propagating network. This interval neural network (INN) has interval valued…

Machine Learning · Computer Science 2020-03-27 Luis Oala , Cosmas Heiß , Jan Macdonald , Maximilian März , Wojciech Samek , Gitta Kutyniok