English
Related papers

Related papers: Learning Likelihood Ratios with Neural Network Cla…

200 papers

With the widespread success of deep neural networks in science and technology, it is becoming increasingly important to quantify the uncertainty of the predictions produced by deep learning. In this paper, we introduce a new method that…

Machine Learning · Computer Science 2019-08-15 Qingyang Wu , He Li , Lexin Li , Zhou Yu

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li

We propose a Likelihood Matching approach for training diffusion models by first establishing an equivalence between the likelihood of the target data distribution and a likelihood along the sample path of the reverse diffusion. To…

Machine Learning · Statistics 2026-01-23 Lei Qian , Wu Su , Yanqi Huang , Song Xi Chen

Neural networks (NN) have achieved state-of-the-art performance in various applications. Unfortunately in applications where training data is insufficient, they are often prone to overfitting. One effective way to alleviate this problem is…

Machine Learning · Computer Science 2016-11-03 Hao Wang , Xingjian Shi , Dit-Yan Yeung

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

Machine Learning · Computer Science 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

Nonparametric regression with random design is considered. Estimates are defined by minimzing a penalized empirical $L_2$ risk over a suitably chosen class of neural networks with one hidden layer via gradient descent. Here, the gradient…

Statistics Theory · Mathematics 2019-12-10 Alina Braun , Michael Kohler , Harro Walk

Recommender systems are important to help users select relevant and personalised information over massive amounts of data available. We propose an unified framework called Preference Network (PN) that jointly models various types of domain…

Information Retrieval · Computer Science 2014-07-23 Tran The Truyen , Dinh Q. Phung , Svetha Venkatesh

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

We consider the link prediction problem in a partially observed network, where the objective is to make predictions in the unobserved portion of the network. Many existing methods reduce link prediction to binary classification problem.…

Machine Learning · Statistics 2016-02-23 Bopeng Li , Sougata Chaudhuri , Ambuj Tewari

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

Machine Learning · Computer Science 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

Machine Learning · Statistics 2018-12-17 Matthew A. Olson , Abraham J. Wyner

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

Probabilistic deep learning is deep learning that accounts for uncertainty, both model uncertainty and data uncertainty. It is based on the use of probabilistic models and deep neural networks. We distinguish two approaches to probabilistic…

Machine Learning · Computer Science 2021-06-10 Daniel T. Chang

We leverage neural networks as universal approximators of monotonic functions to build a parameterization of conditional cumulative distribution functions (CDFs). By the application of automatic differentiation with respect to response…

Machine Learning · Statistics 2020-06-09 Pawel Chilinski , Ricardo Silva

In this work, a deep learning-based method for log-likelihood ratio (LLR) lossy compression and quantization is proposed, with emphasis on a single-input single-output uncorrelated fading communication setting. A deep autoencoder network is…

Machine Learning · Computer Science 2021-05-11 Marius Arvinte , Ahmed H. Tewfik , Sriram Vishwanath

Graphs and networks provide a canonical representation of relational data, with massive network data sets becoming increasingly prevalent across a variety of scientific fields. Although tools from mathematics and computer science have been…

Methodology · Statistics 2014-08-11 Benjamin P. Olding , Patrick J. Wolfe

Neural point estimators are neural networks that map data to parameter point estimates. They are fast, likelihood free and, due to their amortised nature, amenable to fast bootstrap-based uncertainty quantification. In this paper, we aim to…

Methodology · Statistics 2023-10-05 Matthew Sainsbury-Dale , Andrew Zammit-Mangion , Raphaël Huser

A suitable similarity index for comparing learnt neural networks plays an important role in understanding the behaviour of the highly-nonlinear functions, and can provide insights on further theoretical analysis and empirical studies. We…

Machine Learning · Computer Science 2020-03-26 Shuai Tang , Wesley J. Maddox , Charlie Dickens , Tom Diethe , Andreas Damianou

Identifying the obstacle space is crucial for path planning. However, generating an accurate obstacle space remains a significant challenge due to various sources of uncertainty, including motion, behavior, and perception limitations. Even…

Robotics · Computer Science 2025-09-30 Jun Xiang , Jun Chen

We consider training probabilistic classifiers in the case of a large number of classes. The number of classes is assumed too large to perform exact normalisation over all classes. To account for this we consider a simple approach that…

Machine Learning · Statistics 2016-07-08 David Barber , Aleksandar Botev