English
Related papers

Related papers: Technical report: Training Mixture Density Network…

200 papers

This paper provides a framework for estimating the mean and variance of a high-dimensional normal density. The main setting considered is a fixed number of vector following a high-dimensional normal distribution with unknown mean and…

Methodology · Statistics 2019-05-07 Shyamalendu Sinha , Jeffrey D. Hart

Machine learning methods and uncertainty quantification have been gaining interest throughout the last several years in low-energy nuclear physics. In particular, Gaussian processes and Bayesian Neural Networks have increasingly been…

Nuclear Theory · Physics 2022-07-27 A. E. Lovell , A. T. Mohan , T. M. Sprouse , M. R. Mumpower

Human motion prediction, which plays a key role in computer vision, generally requires a past motion sequence as input. However, in real applications, a complete and correct past motion sequence can be too expensive to achieve. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chunzhi Gu , Yan Zhao , Chao Zhang

This PhD Thesis presents an investigation into the analysis of financial returns using mixture models, focusing on mixtures of generalized normal distributions (MGND) and their extensions. The study addresses several critical issues…

Statistical Finance · Quantitative Finance 2024-11-20 Pierdomenico Duttilo

Conditional density estimation (CDE) is the task of estimating the probability of an event conditioned on some inputs. A neural network (NN) can also be used to compute the output distribution for continuous-domain, which can be viewed as…

Machine Learning · Computer Science 2021-12-30 Bing Chen , Mazharul Islam , Jisuo Gao , Lin Wang

Survival analysis, the art of time-to-event modeling, plays an important role in clinical treatment decisions. Recently, continuous time models built from neural ODEs have been proposed for survival analysis. However, the training of neural…

Machine Learning · Computer Science 2022-08-24 Xintian Han , Mark Goldstein , Rajesh Ranganath

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Deterministic mathematical models, such as those specified via differential equations, are a powerful tool to communicate scientific insight. However, such models are necessarily simplified descriptions of the real world. Generalised…

Methodology · Statistics 2025-03-24 Zheyang Shen , Jeremias Knoblauch , Sam Power , Chris. J. Oates

Albeit worryingly underrated in the recent literature on machine learning in general (and, on deep learning in particular), multivariate density estimation is a fundamental task in many applications, at least implicitly, and still an open…

Neural and Evolutionary Computing · Computer Science 2020-12-08 Edmondo Trentin

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the…

Machine Learning · Computer Science 2022-07-12 Anthony Vento , Qingyu Zhao , Robert Paul , Kilian M. Pohl , Ehsan Adeli

One of the distinguishing characteristics of modern deep learning systems is that they typically employ neural network architectures that utilize enormous numbers of parameters, often in the millions and sometimes even in the billions.…

Machine Learning · Statistics 2021-11-15 Ben Adlam , Jake Levinson , Jeffrey Pennington

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz

Mixtures of generalized normal distributions (MGND) have gained popularity for modelling datasets with complex statistical behaviours. However, the estimation of the shape parameter within the maximum likelihood framework is quite complex,…

Methodology · Statistics 2025-06-03 Pierdomenico Duttilo , Stefano Antonio Gattone

Mixture density networks are neural networks that produce Gaussian mixtures to represent continuous multimodal conditional densities. Standard training procedures involve maximum likelihood estimation using the negative log-likelihood (NLL)…

Machine Learning · Computer Science 2026-02-12 Yutao Chen , Jasmine Bayrooti , Steven Morad

A density matrix describes the statistical state of a quantum system. It is a powerful formalism to represent both the quantum and classical uncertainty of quantum systems and to express different statistical operations such as measurement,…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Alejandro Gallego , Santiago Toledo-Cortés , Vladimir Vargas-Calderón

This work introduces a family of univariate constrained mixtures of generalized normal distributions (CMGND) where the location, scale, and shape parameters can be constrained to be equal across any subset of mixture components. An…

Methodology · Statistics 2025-06-05 Pierdomenico Duttilo , Stefano Antonio Gattone , Alfred Kume

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

The recent introduction of Graph Neural Networks (GNNs) and their growing popularity in the past few years has enabled the application of deep learning algorithms to non-Euclidean, graph-structured data. GNNs have achieved state-of-the-art…

Machine Learning · Computer Science 2020-10-27 Tuomas P. Oikarinen , Daniel C. Hannah , Sohrob Kazerounian

Ensuring the conformance of a service system's end-to-end delay to service level agreement (SLA) constraints is a challenging task that requires statistical measures beyond the average delay. In this paper, we study the real-time prediction…

Performance · Computer Science 2020-07-01 Majid Raeis , Ali Tizghadam , Alberto Leon-Garcia