English
Related papers

Related papers: Technical report: Training Mixture Density Network…

200 papers

There is wide interest in studying how the distribution of a continuous response changes with a predictor. We are motivated by environmental applications in which the predictor is the dose of an exposure and the response is a health…

Methodology · Statistics 2018-05-10 Antonio Canale , Daniele Durante , David Dunson

Within Bayesian nonparametrics, dependent Dirichlet process mixture models provide a highly flexible approach for conducting inference about the conditional density function. However, several formulations of this class make either rather…

Methodology · Statistics 2024-05-14 María Xosé Rodríguez-Álvarez , Vanda Inácio , Nadja Klein

In the mixture models problem it is assumed that there are $K$ distributions $\theta_{1},\ldots,\theta_{K}$ and one gets to observe a sample from a mixture of these distributions with unknown coefficients. The goal is to associate instances…

Machine Learning · Statistics 2013-12-02 Jason D Lee , Ran Gilad-Bachrach , Rich Caruana

This paper studies a novel problem of out-of-distribution graph models merging, which aims to construct a generalized model from multiple graph models pre-trained on different domains with distribution discrepancy. This problem is…

Machine Learning · Computer Science 2026-03-18 Yidi Wang , Ziyue Qiao , Jiawei Gu , Xubin Zheng , Pengyang Wang , Xiaobing Pei , Xiao Luo

Bayesian Neural Networks (BNNs) offer probability distributions for model parameters, enabling uncertainty quantification in predictions. However, they often underperform compared to deterministic neural networks. Utilizing mutual learning…

Machine Learning · Computer Science 2024-07-04 Cuong Pham , Cuong C. Nguyen , Trung Le , Dinh Phung , Gustavo Carneiro , Thanh-Toan Do

Multivariate density estimation is a popular technique in statistics with wide applications including regression models allowing for heteroskedasticity in conditional variances. The estimation problems become more challenging when…

Methodology · Statistics 2018-08-15 Zhen Li , Lili Wu , Weilian Zhou , Sujit Ghosh

Prediction and control of chemical mixing are vital for many scientific areas such as subsurface reactive transport, climate modeling, combustion, epidemiology, and pharmacology. Due to the complex nature of mixing in heterogeneous and…

Machine Learning · Computer Science 2021-12-15 N. V. Jagtap , M. K. Mudunuru , K. B. Nakshatrala

In this paper, we propose an uncertainty-aware learning from demonstration method by presenting a novel uncertainty estimation method utilizing a mixture density network appropriate for modeling complex and noisy human behaviors. The…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Sungjoon Choi , Kyungjae Lee , Sungbin Lim , Songhwai Oh

Computational chemistry has come a long way over the course of several decades, enabling subatomic level calculations particularly with the development of Density Functional Theory (DFT). Recently, machine-learned potentials (MLP) have…

Deep Neural Networks (DNNs) have become increasingly popular in computer vision, natural language processing, and other areas. However, training and fine-tuning a deep learning model is computationally intensive and time-consuming. We…

Machine Learning · Computer Science 2018-07-04 Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Modern approaches to supervised learning like deep neural networks (DNNs) typically implicitly assume that observed responses are statistically independent. In contrast, correlated data are prevalent in real-life large-scale applications,…

Machine Learning · Statistics 2023-01-30 Giora Simchoni , Saharon Rosset

Deep learning-based multivariate and multistep-ahead traffic forecasting models are typically trained with the mean squared error (MSE) or mean absolute error (MAE) as the loss function in a sequence-to-sequence setting, simply assuming…

Machine Learning · Computer Science 2026-01-28 Seongjin Choi , Nicolas Saunier , Vincent Zhihao Zheng , Martin Trepanier , Lijun Sun

Accurate estimation of intravoxel incoherent motion (IVIM) parameters from diffusion-weighted MRI remains challenging due to the ill-posed nature of the inverse problem and high sensitivity to noise, particularly in the perfusion…

Networks are often characterized by node heterogeneity for which nodes exhibit different degrees of interaction and link homophily for which nodes sharing common features tend to associate with each other. In this paper, we propose a new…

Methodology · Statistics 2018-03-13 Ting Yan , Binyan Jiang , Stephen E. Fienberg , Chenlei Leng

Machine Learning is a powerful tool to reveal and exploit correlations in a multi-dimensional parameter space. Making predictions from such correlations is a highly non-trivial task, in particular when the details of the underlying dynamics…

High Energy Physics - Phenomenology · Physics 2019-01-30 Christoph Englert , Peter Galler , Philip Harris , Michael Spannowsky

Regularized regression models are well studied and, under appropriate conditions, offer fast and statistically interpretable results. However, large data in many applications are heterogeneous in the sense of harboring distributional…

Methodology · Statistics 2022-10-25 Konstantinos Perrakis , Thomas Lartigue , Frank Dondelinger , Sach Mukherjee

In deep learning, dense layer connectivity has become a key design principle in deep neural networks (DNNs), enabling efficient information flow and strong performance across a range of applications. In this work, we model densely connected…

Machine Learning · Computer Science 2025-10-03 Jinshu Huang , Haibin Su , Xue-Cheng Tai , Chunlin Wu

The rapid development of machine learning (ML) and artificial intelligence (AI) applications requires the training of large numbers of models. This growing demand highlights the importance of training models without human supervision, while…

Machine Learning · Computer Science 2025-05-26 Alexey Boldyrev , Fedor Ratnikov , Andrey Shevelev

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

We propose a general framework for non-normal multivariate data analysis called multivariate covariance generalized linear models (McGLMs), designed to handle multivariate response variables, along with a wide range of temporal and spatial…

Methodology · Statistics 2017-04-25 Wagner Hugo Bonat , Bent Jørgensen