English
Related papers

Related papers: Neural Mixture Distributional Regression

200 papers

Non-Gaussian and multimodal distributions are an important part of many recent robust sensor fusion algorithms. In difference to robust cost functions, they are probabilistically founded and have good convergence properties. Since their…

Robotics · Computer Science 2020-01-14 Tim Pfeifer , Peter Protzel

We consider a problem of linear model selection in the presence of both continuous and categorical predictors. Feasible models consist of subsets of numerical variables and partitions of levels of factors. A new algorithm called delete or…

Applications · Statistics 2015-12-22 Aleksandra Maj-Kańska , Piotr Pokarowski , Agnieszka Prochenka

We propose a neural operator framework, termed mixture density nonlinear manifold decoder (MD-NOMAD), for stochastic simulators. Our approach leverages an amalgamation of the pointwise operator learning neural architecture nonlinear…

Machine Learning · Computer Science 2025-05-13 Akshay Thakur , Souvik Chakraborty

Mixed membership models are an extension of finite mixture models, where each observation can partially belong to more than one mixture component. A probabilistic framework for mixed membership models of high-dimensional continuous data is…

Motivation: Drug combination is a sensible strategy for disease treatment by improving the efficacy and reducing concomitant side effects. Due to the large number of possible combinations among candidate compounds, exhaustive screening is…

Quantitative Methods · Quantitative Biology 2020-02-26 Liang Yu , Mingfei Xia , Lin Gao

In this paper, we propose a novel Convolutional Neural Network (CNN) structure for general-purpose multi-task learning (MTL), which enables automatic feature fusing at every layer from different tasks. This is in contrast with the most…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yuan Gao , Jiayi Ma , Mingbo Zhao , Wei Liu , Alan L. Yuille

The exponential growth in the number of complex datasets every year requires more enhancement in machine learning methods to provide robust and accurate data classification. Lately, deep learning approaches have achieved surpassing results…

Machine Learning · Computer Science 2018-10-22 Mojtaba Heidarysafa , Kamran Kowsari , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes

The rapidly growing size of deep neural network (DNN) models and datasets has given rise to a variety of distribution strategies such as data, tensor-model, pipeline parallelism, and hybrid combinations thereof. Each of these strategies…

Machine Learning · Computer Science 2021-11-11 Keshav Santhanam , Siddharth Krishna , Ryota Tomioka , Tim Harris , Matei Zaharia

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

The success of deep learning techniques over the last decades has opened up a new avenue of research for weather forecasting. Here, we take the novel approach of using a neural network to predict full probability density functions at each…

Machine Learning · Statistics 2022-01-05 Mariana Clare , Omar Jamil , Cyril Morcrette

Despite their empirical success, most existing listwiselearning-to-rank (LTR) models are not built to be robust to errors in labeling or annotation, distributional data shift, or adversarial data perturbations. To fill this gap, we…

Machine Learning · Computer Science 2021-09-28 Shahabeddin Sotudian , Ruidi Chen , Ioannis Paschalidis

Any clustering algorithm must synchronously learn to model the clusters and allocate data to those clusters in the absence of labels. Mixture model-based methods model clusters with pre-defined statistical distributions and allocate data to…

Machine Learning · Computer Science 2022-10-04 Dumindu Tissera , Kasun Vithanage , Rukshan Wijesinghe , Alex Xavier , Sanath Jayasena , Subha Fernando , Ranga Rodrigo

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for analyzing nonnegative data. A key aspect of NMF is the choice of the objective function that depends on the noise model (or statistics of the noise)…

Machine Learning · Computer Science 2021-02-10 Nicolas Gillis , Le Thi Khanh Hien , Valentin Leplat , Vincent Y. F. Tan

Finite mixture distributions arise in sampling a heterogeneous population. Data drawn from such a population will exhibit extra variability relative to any single subpopulation. Statistical models based on finite mixtures can assist in the…

Methodology · Statistics 2024-01-19 Andrew M. Raim , Nagaraj K. Neerchal , Jorge G. Morel

Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data,…

Machine Learning · Statistics 2022-10-13 Domagoj Ćevid , Loris Michel , Jeffrey Näf , Nicolai Meinshausen , Peter Bühlmann

This work introduces a family of univariate constrained mixtures of generalized normal distributions (CMGND) where the location, scale, and shape parameters can be constrained to be equal across any subset of mixture components. An…

Methodology · Statistics 2025-06-05 Pierdomenico Duttilo , Stefano Antonio Gattone , Alfred Kume

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu

This paper proposes a two-time scale neurodynamic duplex approach to solve distributionally robust geometric joint chance-constrained optimization problems. The probability distributions of the row vectors are not known in advance and…

Neural and Evolutionary Computing · Computer Science 2026-05-07 Ange Valli , Siham Tassouli , Abdel Lisser

We propose a neural hybrid model consisting of a linear model defined on a set of features computed by a deep, invertible transformation (i.e. a normalizing flow). An attractive property of our model is that both p(features), the density of…

Machine Learning · Computer Science 2019-05-30 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Dilan Gorur , Balaji Lakshminarayanan

We propose an extensive framework for additive regression models for correlated functional responses, allowing for multiple partially nested or crossed functional random effects with flexible correlation structures for, e.g., spatial,…

Methodology · Statistics 2013-11-26 Fabian Scheipl , Ana-Maria Staicu , Sonja Greven