English
Related papers

Related papers: Scalable Expectation Propagation for Mixed-Effects…

200 papers

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional…

Methodology · Statistics 2020-06-30 Nadja Klein , Manuel Carlan , Thomas Kneib , Stefan Lang , Helga Wagner

Mixture models provide a flexible representation of heterogeneity in a finite number of latent classes. From the Bayesian point of view, Markov Chain Monte Carlo methods provide a way to draw inferences from these models. In particular,…

Methodology · Statistics 2020-05-06 Carolina Valani Cavalcante , Kelly Cristina Mota Gonçalves

A mixture of experts models the conditional density of a response variable using a mixture of regression models with covariate-dependent mixture weights. We extend the finite mixture of experts model by allowing the parameters in both the…

Computation · Statistics 2022-10-14 Parfait Munezero , Mattias Villani , Robert Kohn

We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or…

Machine Learning · Statistics 2018-04-04 Abubakar Abid , James Zou

When fitting generalized linear mixed models (GLMMs), one important decision to make relates to the choice of the random effects distribution. As the random effects are unobserved, misspecification of this distribution is a real…

Methodology · Statistics 2024-12-02 Quan Vu , Francis K. C. Hui , Samuel Muller , A. H. Welsh

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation…

Machine Learning · Statistics 2021-04-06 Vitor Cerqueira , Luis Torgo , Carlos Soares , Albert Bifet

A weighted likelihood technique for robust estimation of a multivariate Wrapped Normal distribution for data points scattered on a p-dimensional torus is proposed. The occurrence of outliers in the sample at hand can badly compromise…

Methodology · Statistics 2021-07-01 Giovanni Saraceno , Claudio Agostinelli , Luca Greco

Equilibrium Propagation (EP) is a powerful and more bio-plausible alternative to conventional learning frameworks such as backpropagation. The effectiveness of EP stems from the fact that it relies only on local computations and requires…

Neural and Evolutionary Computing · Computer Science 2023-08-23 Malyaban Bal , Abhronil Sengupta

We consider the statistical analysis of heterogeneous data for prediction in situations where the observations include functions, typically time series. We extend the modeling with Mixtures-of-Experts (ME), as a framework of choice in…

Methodology · Statistics 2023-12-21 Faïcel Chamroukhi , Nhat Thien Pham , Van Hà Hoang , Geoffrey J. McLachlan

Many modern experiments, such as microarray gene expression and genome-wide association studies, present the problem of estimating a large number of parallel effects. Bayesian inference is a popular approach for analyzing such data by…

Methodology · Statistics 2018-10-26 J G Liao , Arthur Berg , Timothy L McMurry

The fundamental problem of line spectral estimation (LSE) using the expectation propagation (EP) method is studied. Previous approaches estimate the model order sequentially, limiting their practical utility in scenarios with large…

Information Theory · Computer Science 2025-02-24 Jiang Zhu , Xupeng Lei , Mihai Alin-Badiu , Fengzhong Qu

Probit models are useful for modeling correlated discrete responses in many disciplines, including consumer choice data in economics and marketing. However, the Gaussian latent variable feature of probit models coupled with identification…

Methodology · Statistics 2024-09-30 Patrick Ding , Guido Imbens , Zhaonan Qu , Yinyu Ye

The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and…

Artificial Intelligence · Computer Science 2016-09-20 Priyank Jaini , Pascal Poupart

This paper investigates sparse signal recovery based on expectation propagation (EP) from unitarily invariant measurements. A rigorous analysis is presented for the state evolution (SE) of an EP-based message-passing algorithm in the large…

Information Theory · Computer Science 2017-04-06 Keigo Takeuchi

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis , Annamaria Guolo , Cristiano Varin

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

Machine Learning · Computer Science 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

Linear mixed-effects models are widely used in analyzing clustered or repeated measures data. We propose a quasi-likelihood approach for estimation and inference of the unknown parameters in linear mixed-effects models with high-dimensional…

Methodology · Statistics 2021-03-10 Sai Li , Tony T. Cai , Hongzhe Li

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of…

Numerical Analysis · Mathematics 2015-06-18 Matthias Gehre , Bangti Jin

The functional linear model is a popular tool to investigate the relationship between a scalar/functional response variable and a scalar/functional covariate. We generalize this model to a functional linear mixed-effects model when repeated…

Methodology · Statistics 2016-01-07 Baisen Liu , Jiguo Cao

When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex machine learning methods.…

Machine Learning · Statistics 2022-06-17 Chen Xu , Yao Xie