English
Related papers

Related papers: Efficient Maximum Likelihood Estimation of Multipl…

200 papers

Generalized linear mixed models (GLMMs) are used to model responses from exponential families with a combination of fixed and random effects. For variance components in GLMMs, we propose an approximate restricted likelihood ratio test that…

Methodology · Statistics 2019-06-11 Stephanie T. Chen , Luo Xiao , Ana-Maria Staicu

We present an approach for continual learning (CL) that is based on fully probabilistic (or generative) models of machine learning. In contrast to, e.g., GANs that are "generative" in the sense that they can generate samples, fully…

Machine Learning · Computer Science 2021-04-20 Benedikt Pfülb , Alexander Gepperth , Benedikt Bagus

This study presents a semi-nonparametric Latent Class Choice Model (LCCM) with a flexible class membership component. The proposed model formulates the latent classes using mixture models as an alternative approach to the traditional random…

Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for…

Machine Learning · Statistics 2017-01-18 Qiuyang Liu , Shiliang Sun

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

High-dimensional longitudinal data is increasingly used in a wide range of scientific studies. To properly account for dependence between longitudinal observations, statistical methods for high-dimensional linear mixed models (LMMs) have…

Methodology · Statistics 2024-07-10 Anja Zgodic , Ray Bai , Jiajia Zhang , Peter Olejua , Alexander C. McLain

Latent Gaussian models have a rich history in statistics and machine learning, with applications ranging from factor analysis to compressed sensing to time series analysis. The classical method for maximizing the likelihood of these models…

Machine Learning · Computer Science 2023-06-07 Alexander Lin , Bahareh Tolooshams , Yves Atchadé , Demba Ba

Multivariate linear mixed models (mvLMMs) have been widely used in many areas of genetics, and have attracted considerable recent interest in genome-wide association studies (GWASs). However, fitting mvLMMs is computationally non-trivial,…

Quantitative Methods · Quantitative Biology 2013-09-13 Xiang Zhou , Matthew Stephens

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

This article introduces a nonlinear generalized matrix factor model (GMFM) that allows for mixed-type variables, extending the scope of linear matrix factor models (LMFM) that are so far limited to handling continuous variables. We…

Methodology · Statistics 2024-09-17 Xinbing Kong , Tong Zhang

Analyses of time to event datasets have been invariably based on the Cox proportional hazards model (PHM). Reformulations of the PHM as a Poisson Generalized Additive Model (GAM) or as a Generalized Linear Mixed Model (GLMM) have been…

Methodology · Statistics 2025-03-17 Christos Argyropoulos , Hamza Mir , Maria-Eleni Roumelioti , Pablo Garcia

In this paper, we study a generalization of the two-groups model in the presence of covariates --- a problem that has recently received much attention in the statistical literature due to its applicability in multiple hypotheses testing…

Methodology · Statistics 2019-02-01 Nabarun Deb , Sujayam Saha , Adityanand Guntuboyina , Bodhisattva Sen

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

Gradient Boosting Machines (GBM) are hugely popular for solving tabular data problems. However, practitioners are not only interested in point predictions, but also in probabilistic predictions in order to quantify the uncertainty of the…

Machine Learning · Computer Science 2021-06-08 Olivier Sprangers , Sebastian Schelter , Maarten de Rijke

Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their popularity, they can be difficult to apply; all but the simplest classification or…

Machine Learning · Computer Science 2016-01-06 Ulrich Schaechtle , Ben Zinberg , Alexey Radul , Kostas Stathis , Vikash K. Mansinghka

The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is required in…

Methodology · Statistics 2023-12-13 Nora Ouzir , Frédéric Pascal , Jean-Christophe Pesquet

We propose a novel exponentially-modified Gaussian (EMG) mixture residual model. The EMG mixture is well suited to model residuals that are contaminated by a distribution with positive support. This is in contrast to commonly used robust…

Machine Learning · Statistics 2019-02-18 Sebastian Ament , John Gregoire , Carla Gomes

One major obstacle towards AI is the poor ability of models to solve new problems quicker, and without forgetting previously acquired knowledge. To better understand this issue, we study the problem of continual learning, where the model…

Machine Learning · Computer Science 2022-09-14 David Lopez-Paz , Marc'Aurelio Ranzato

Spatial generalized linear mixed models (SGLMMs) are popular and flexible models for non-Gaussian spatial data. They are useful for spatial interpolations as well as for fitting regression models that account for spatial dependence, and are…

Methodology · Statistics 2021-10-26 Yawen Guan , Murali Haran

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…

Machine Learning · Statistics 2020-06-05 Trefor W. Evans , Prasanth B. Nair