English
Related papers

Related papers: Repulsive g-Priors for Regression Mixtures

200 papers

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

In this article, we propose a data-driven methodology for combining the solutions of a set of competing turbulence models. The individual model predictions are linearly combined for providing an ensemble solution accompanied by estimates of…

Fluid Dynamics · Physics 2023-01-24 Maximilien de Zordo-Banliat , Grégory Dergham , Xavier Merle , Paola Cinnella

This paper presents a unified treatment of Gaussian process models that extends to data from the exponential dispersion family and to survival data. Our specific interest is in the analysis of data sets with predictors that have an a priori…

Methodology · Statistics 2011-06-17 Terrance Savitsky , Marina Vannucci , Naijun Sha

In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a \textit {mode collapse} issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Seyed Mehdi Iranmanesh , Nasser M. Nasrabadi

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

In this paper, we study Bayesian approach for solving large scale linear inverse problems arising in various scientific and engineering fields. We propose a fused $L_{1/2}$ prior with edge-preserving and sparsity-promoting properties and…

Computation · Statistics 2025-12-17 Xiongwen Ke , Yanan Fan , Qingping Zhou

Deep ensembles have recently gained popularity in the deep learning community for their conceptual simplicity and efficiency. However, maintaining functional diversity between ensemble members that are independently trained with gradient…

Machine Learning · Computer Science 2023-03-29 Francesco D'Angelo , Vincent Fortuin

We introduce a new empirical Bayes approach for large-scale multiple linear regression. Our approach combines two key ideas: (i) the use of flexible "adaptive shrinkage" priors, which approximate the nonparametric family of scale mixture of…

Methodology · Statistics 2024-06-13 Youngseok Kim , Wei Wang , Peter Carbonetto , Matthew Stephens

Federated Bayesian neural networks require fixing a prior on the model parameters together with a likelihood. Eliciting meaningful priors on the weight space of modern overparameterized models is notoriously difficult, and misspecification…

Machine Learning · Computer Science 2026-05-19 Boning Zhang , Matteo Zecchin , Mingzhao Guo , Dongzhu Liu , Osvaldo Simeone

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

Outlying observations can be challenging to handle and adversely affect subsequent analyses, especially in data with increasing dimensional complexity. Although outliers are not always undesired anomalies in the data and may possess…

Methodology · Statistics 2025-09-18 Anthony-Alexander Christidis , Gabriela Cohen-Freue

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Shape restricted regressions, including isotonic regression and concave regression as special cases, are studied using priors on Bernstein polynomials and Markov chain Monte Carlo methods. These priors have large supports, select only…

Statistics Theory · Mathematics 2009-09-29 I-Shou Chang , Li-Chu Chien , Chao A. Hsiung , Chi-Chung Wen , Yuh-Jenn Wu

Group-based sparsity models are proven instrumental in linear regression problems for recovering signals from much fewer measurements than standard compressive sensing. The main promise of these models is the recovery of "interpretable"…

Machine Learning · Computer Science 2015-03-05 Luca Baldassarre , Nirav Bhan , Volkan Cevher , Anastasios Kyrillidis , Siddhartha Satpathi

We propose a novel semiparametric classifier based on Mahalanobis distances of an observation from the competing classes. Our tool is a generalized additive model with the logistic link function that uses these distances as features to…

Methodology · Statistics 2025-02-05 Annesha Ghosh , Anil K. Ghosh , Rita SahaRay , Soham Sarkar

The development of prior distributions for Bayesian regression has traditionally been driven by the goal of achieving sensible model selection and parameter estimation. The formalization of properties that characterize good performance has…

Statistics Theory · Mathematics 2015-01-14 Agniva Som , Christopher M. Hans , Steven N. MacEachern

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

While split conformal prediction guarantees marginal coverage, approaching the stronger property of conditional coverage is essential for reliable uncertainty quantification. Naive conformal scores, however, suffer from poor conditional…

Machine Learning · Statistics 2026-05-08 Sacha Braun , Eugène Berta , Michael I. Jordan , Francis Bach

In Bayesian machine learning, conjugate priors are popular, mostly due to mathematical convenience. In this paper, we show that there are deeper reasons for choosing a conjugate prior. Specifically, we formulate the conjugate prior in the…

Machine Learning · Computer Science 2010-05-04 Arvind Agarwal , Hal Daume

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz