English
Related papers

Related papers: Concave likelihood-based regression with finite-su…

200 papers

A constrained multivariate linear model is a multivariate linear model with the columns of its coefficient matrix constrained to lie in a known subspace. This class of models includes those typically used to study growth curves and…

Methodology · Statistics 2021-01-05 Dennis Cook , Liliana Forzani , Lan Liu

Reliably characterizing the full conditional distribution of a multivariate response variable given a set of covariates is crucial for trustworthy decision-making. However, misspecified or miscalibrated multivariate models may yield a poor…

Machine Learning · Computer Science 2025-10-27 Victor Dheur , Souhaib Ben Taieb

A composite likelihood is an inference function derived by multiplying a set of likelihood components. This approach provides a flexible framework for drawing inference when the likelihood function of a statistical model is computationally…

Methodology · Statistics 2024-12-10 Giuseppe Alfonzetti , Ruggero Bellio , Yunxiao Chen , Irini Moustaki

We develop a unified approach for classification and regression support vector machines for data subject to right censoring. We provide finite sample bounds on the generalization error of the algorithm, prove risk consistency for a wide…

Machine Learning · Statistics 2013-01-15 Yair Goldberg , Michael R. Kosorok

The Ising model is a useful tool for studying complex interactions within a system. The estimation of such a model, however, is rather challenging, especially in the presence of high-dimensional parameters. In this work, we propose…

Statistics Theory · Mathematics 2012-08-20 Lingzhou Xue , Hui Zou , Tianxi Cai

Survival analysis is a hotspot in statistical research for modeling time-to-event information with data censorship handling, which has been widely used in many applications such as clinical research, information system and other fields with…

Machine Learning · Computer Science 2018-11-14 Kan Ren , Jiarui Qin , Lei Zheng , Zhengyu Yang , Weinan Zhang , Lin Qiu , Yong Yu

We study the proximal sampler of Lee, Shen, and Tian (2021) and obtain new convergence guarantees under weaker assumptions than strong log-concavity: namely, our results hold for (1) weakly log-concave targets, and (2) targets satisfying…

Statistics Theory · Mathematics 2022-02-15 Yongxin Chen , Sinho Chewi , Adil Salim , Andre Wibisono

Logistic regression model is widely used in many studies to investigate the relationship between a binary response variable Y and a set of potential predictors $X_1,\ldots, X_p$ (for example: $Y = 1$ if the outcome occurred and $Y = 0$…

Methodology · Statistics 2025-02-25 Mouhamed Ndoye , Aba Diop

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

We consider the problem of causal inference based on observational data (or the related missing data problem) with a binary or discrete treatment variable. In that context, we study inference for the counterfactual density functions and…

Methodology · Statistics 2024-12-13 Daeyoung Ham , Ted Westling , Charles R. Doss

We propose a penalized likelihood method to fit the bivariate categorical response regression model. Our method allows practitioners to estimate which predictors are irrelevant, which predictors only affect the marginal distributions of the…

Methodology · Statistics 2022-01-25 Aaron J. Molstad , Adam J. Rothman

Conformal prediction is a theoretically grounded framework for constructing predictive intervals. We study conformal prediction with missing values in the covariates -- a setting that brings new challenges to uncertainty quantification. We…

Machine Learning · Statistics 2023-06-06 Margaux Zaffran , Aymeric Dieuleveut , Julie Josse , Yaniv Romano

We propose a framework for analyzing the sensitivity of counterfactuals to parametric assumptions about the distribution of latent variables in structural models. In particular, we derive bounds on counterfactuals as the distribution of…

Econometrics · Economics 2024-03-26 Timothy Christensen , Benjamin Connault

The aim of this note is to state a couple of general results about the properties of the penalized maximum likelihood estimators (pMLE) and of the posterior distribution for parametric models in a non-asymptotic setup and for possibly large…

Statistics Theory · Mathematics 2022-12-13 Vladimir Spokoiny

Spaces of convex and concave functions appear naturally in theory and applications. For example, convex regression and log-concave density estimation are important topics in nonparametric statistics. In stochastic portfolio theory, concave…

Probability · Mathematics 2021-05-25 Peter Baxendale , Ting-Kam Leonard Wong

A class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by Fan and Li to simultaneously estimate parameters and select important variables. They demonstrated that this class of…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Heng Peng

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

The last decade has seen max-stable processes emerge as a common tool for the statistical modeling of spatial extremes. However, their application is complicated due to the unavailability of the multivariate density function, and so…

Methodology · Statistics 2009-02-23 Simone A. Padoan , Mathieu Ribatet , Scott A. Sisson

We consider a binary sequence generated by thresholding a hidden continuous sequence. The hidden variables are assumed to have a compound symmetry covariance structure with a single parameter characterizing the common correlation. We study…

Statistics Theory · Mathematics 2019-09-04 Haolei Weng , Yang Feng

Fan and Li propose a family of variable selection methods via penalized likelihood using concave penalty functions. The nonconcave penalized likelihood estimators enjoy the oracle properties, but maximizing the penalized likelihood function…

Statistics Theory · Mathematics 2008-08-08 Hui Zou , Runze Li