English
Related papers

Related papers: On the "Poisson Trick" and its Extensions for Fitt…

200 papers

Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even…

Methodology · Statistics 2024-09-17 Hanmei Sun , Jiangshan Zhang , Jiming Jiang

Predicting with missing inputs challenges even parametric models, as parameter estimation alone is insufficient for prediction on incomplete data. While several works study prediction in linear models, we focus on logistic models, where…

Machine Learning · Statistics 2026-02-03 Christophe Muller , Erwan Scornet , Julie Josse

We introduce a new algorithm for approximate inference that combines reparametrization, Markov chain Monte Carlo and variational methods. We construct a very flexible implicit variational distribution synthesized by an arbitrary Markov…

Machine Learning · Statistics 2017-08-07 Michalis K. Titsias

We propose a method for estimating coefficients in multivariate regression when there is a clustering structure to the response variables. The proposed method includes a fusion penalty, to shrink the difference in fitted values from…

Machine Learning · Statistics 2018-03-28 Bradley S. Price , Ben Sherwood

We propose a novel framework for fitting additive quantile regression models, which provides well calibrated inference about the conditional quantiles and fast automatic estimation of the smoothing parameters, for model structures as…

Methodology · Statistics 2020-03-13 M. Fasiolo , S. N. Wood , M. Zaffran , R. Nedellec , Y. Goude

The continuous extension of a discrete random variable is amongst the computational methods used for estimation of multivariate normal copula-based models with discrete margins. Its advantage is that the likelihood can be derived…

Methodology · Statistics 2014-11-10 Aristidis K. Nikoloulopoulos

Additive models enjoy the flexibility of nonlinear models while still being readily understandable to humans. By contrast, other nonlinear models, which involve interactions between features, are not only harder to fit but also…

Methodology · Statistics 2025-06-03 Yiling Huang , Snigdha Panigrahi , Guo Yu , Jacob Bien

Gaussian mixture models (GMMs) are ubiquitous in statistical learning, particularly for unsupervised problems. While full GMMs suffer from the overparameterization of their covariance matrices in high-dimensional spaces, spherical GMMs…

Machine Learning · Statistics 2025-11-10 Tom Szwagier , Pierre-Alexandre Mattei , Charles Bouveyron , Xavier Pennec

There is a rich literature for modeling binary and polychotomous responses. However, existing methods are inadequate for handling combinatorial responses, where each response is an integer array under additional constraints. Such data are…

Methodology · Statistics 2026-05-05 Yu Zheng , Malay Ghosh , Leo Duan

Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation…

Machine Learning · Statistics 2022-08-25 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

The Conway-Maxwell-Poisson (CMP) or COM-Poison regression is a popular model for count data due to its ability to capture both under dispersion and over dispersion. However, CMP regression is limited when dealing with complex nonlinear…

Methodology · Statistics 2020-04-27 Suneel Babu Chatla , Galit Shmueli

Network models are useful tools for modelling complex associations. If a Gaussian graphical model is assumed, conditional independence is determined by the non-zero entries of the inverse covariance (precision) matrix of the data. The…

Methodology · Statistics 2023-04-18 Camilla Lingjærde , Benjamin P. Fairfax , Sylvia Richardson , Hélène Ruffieux

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive…

Statistics Theory · Mathematics 2008-04-09 Pradeep Ravikumar , John Lafferty , Han Liu , Larry Wasserman

When estimating a regression model, we might have data where some labels are missing, or our data might be biased by a selection mechanism. When the response or selection mechanism is ignorable (i.e., independent of the response variable…

Statistics Theory · Mathematics 2023-08-22 Philip Boeken , Noud de Kroon , Mathijs de Jong , Joris M. Mooij , Onno Zoeter

Multinomial logistic regression is one of the most popular models for modelling the effect of explanatory variables on a subject choice between a set of specified options. This model has found numerous applications in machine learning,…

Methodology · Statistics 2012-10-19 Cedric Archambeau , Francois Caron

We consider the nonparametric regression problem with multiple predictors and an additive error, where the regression function is assumed to be coordinatewise nondecreasing. We propose a Bayesian approach to make an inference on the…

Statistics Theory · Mathematics 2022-11-24 Kang Wang , Subhashis Ghosal

We consider efficient estimation of flexible transformation models with interval-censored data. To reduce the dimension of semi-parametric models, the unknown monotone transformation function is approximated via monotone splines. A…

Methodology · Statistics 2019-12-30 Minggen Lu , Yan Liu , Chin-Shang Li , Jianguo Sun

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

Parameter estimation in logistic regression is a well-studied problem with the Newton-Raphson method being one of the most prominent optimization techniques used in practice. A number of monotone optimization methods including…

Computation · Statistics 2023-04-11 Nicholas C. Henderson , Zhongzhe Ouyang