English
Related papers

Related papers: Gradient boosting in Markov-switching generalized …

200 papers

Model-based component-wise gradient boosting is a popular tool for data-driven variable selection. In order to improve its prediction and selection qualities even further, several modifications of the original algorithm have been developed,…

Methodology · Statistics 2023-02-28 Sophie Potts , Elisabeth Bergherr , Constantin Reinke , Colin Griesbach

Markov chain Monte Carlo methods for exponential family models with intractable normalizing constant, such as the exchange algorithm, require simulations of the sufficient statistics at every iteration of the Markov chain, which often…

Computation · Statistics 2023-02-21 Quan Vu , Matthew T. Moores , Andrew Zammit-Mangion

A non-Bayesian, regression-based or generalized least squares (GLS)-based approach is formally proposed to estimate a class of time-varying AR parameter models. This approach has partly been used by Ito et al. (2014, 2016a,b), and is proven…

Methodology · Statistics 2017-12-22 Mikio Ito , Akihiko Noda , Tatsuma Wada

Generation of molecules with desired chemical and biological properties such as high drug-likeness, high binding affinity to target proteins, is critical for drug discovery. In this paper, we propose a probabilistic generative model to…

Biomolecules · Quantitative Biology 2023-07-12 Deqian Kong , Bo Pang , Tian Han , Ying Nian Wu

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped random effects models…

Machine Learning · Computer Science 2024-11-06 Fabio Sigrist

Modelling longitudinal data is an important yet challenging task. These datasets can be high-dimensional, contain non-linear effects and time-varying covariates. Gaussian process (GP) prior-based variational autoencoders (VAEs) have emerged…

Machine Learning · Computer Science 2024-09-18 Priscilla Ong , Manuel Haußmann , Otto Lönnroth , Harri Lähdesmäki

This paper introduces a mathematical framework of a stochastic process model as a generalization of diffusion stochastic processes to model latent variables in categorical responses given unobserved random effects and maximum likelihood…

Statistics Theory · Mathematics 2023-06-05 Mahdi Mollakazemiha

We generalize the stochastic block model to the important case in which edges are annotated with weights drawn from an exponential family distribution. This generalization introduces several technical difficulties for model estimation,…

Machine Learning · Statistics 2013-05-27 Christopher Aicher , Abigail Z. Jacobs , Aaron Clauset

Gradient boosting of prediction rules is an efficient approach to learn potentially interpretable yet accurate probabilistic models. However, actual interpretability requires to limit the number and size of the generated rules, and existing…

Machine Learning · Computer Science 2024-02-27 Fan Yang , Pierre Le Bodic , Michael Kamp , Mario Boley

Discrete latent space models have recently achieved performance on par with their continuous counterparts in deep variational inference. While they still face various implementation challenges, these models offer the opportunity for a…

Machine Learning · Statistics 2023-08-22 Max Cohen , Maurice Charbit , Sylvain Le Corff

The statistical modeling of discrete extremes has received less attention than their continuous counterparts in the Extreme Value Theory (EVT) literature. One approach to the transition from continuous to discrete extremes is the modeling…

Methodology · Statistics 2024-06-18 Touqeer Ahmad , Carlo Gaetan , Philippe Naveau

This work targets the identification of a class of models for hybrid dynamical systems characterized by nonlinear autoregressive exogenous (NARX) components, with finite-dimensional polynomial expansions, and by a Markovian switching…

Machine Learning · Computer Science 2020-09-30 Alessandro Brusaferri , Matteo Matteucci , Stefano Spinelli

This paper proposes a general switching dynamical system model, and a custom majorization-minimization-based algorithm EM++ for identifying its parameters. For certain families of distributions, such as Gaussian distributions, this…

Optimization and Control · Mathematics 2025-12-30 Renzi Wang , Alexander Bodard , Mathijs Schuurmans , Panagiotis Patrinos

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

Methodology · Statistics 2021-06-29 Haim Bar , James Booth , Martin T. Wells

Recent advances in the literature have demonstrated that standard supervised learning algorithms are ill-suited for problems with endogenous explanatory variables. To correct for the endogeneity bias, many variants of nonparameteric…

Econometrics · Economics 2021-01-18 Edvard Bakhitov , Amandeep Singh

Current implementations of Gradient Boosting Machines are mostly designed for single-target regression tasks and commonly assume independence between responses when used in multivariate settings. As such, these models are not well suited if…

Machine Learning · Computer Science 2022-10-14 Alexander März

Focusing on regression based analysis of extremes in a presence of systematically missing covariates, this work presents a data-driven spatio-temporal regression based clustering of threshold excesses. It is shown that in a presence of…

Methodology · Statistics 2021-04-02 Olga Kaiser , Dimitri Igdalov , Olivia Martius , Illia Horenko

Statistical boosting algorithms are renowned for their intrinsic variable selection and enhanced predictive performance compared to classical statistical methods, making them especially useful for complex models such as generalized additive…

Methodology · Statistics 2026-02-20 Alexandra Daub , Elisabeth Bergherr

Latent space models are popular for analyzing dynamic network data. We propose a variational approach to estimate the model parameters as well as the latent positions of the nodes in the network. The variational approach is much faster than…

Methodology · Statistics 2021-06-01 Yan Liu , Yuguo Chen