English
Related papers

Related papers: A Two-Stage Approach to Multivariate Linear Regres…

200 papers

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

We propose a structure of a semiparametric two-component mixture model when one component is parametric and the other is defined through linear constraints on its distribution function. Estimation of a two-component mixture model with an…

Methodology · Statistics 2017-12-22 Diaa Al Mohamad , Assia Boumahdaf

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

In paired randomized experiments individuals in a given matched pair may differ on prognostically important covariates despite the best efforts of practitioners. We examine the use of regression adjustment as a way to correct for persistent…

Methodology · Statistics 2017-11-27 Colin B. Fogarty

In this paper, we introduce ``UniLasso'' -- a novel statistical method for sparse regression. This two-stage approach preserves the signs of the univariate coefficients and leverages their magnitude. Both of these properties are attractive…

Methodology · Statistics 2025-06-26 Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

A Two-Stage approach enables researchers to make optimal non-linear predictions via Generalized Ridge Regression using models that contain two or more x-predictor variables and make only realistic minimal assumptions. The optimal regression…

Methodology · Statistics 2023-07-11 Robert L. Obenchain

We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response function is misspecified…

Statistics Theory · Mathematics 2020-02-19 Mariusz Kubkowski , Jan Mielniczuk

Random-effects meta-analyses are very commonly used in medical statistics. Recent methodological developments include multivariate (multiple outcomes) and network (multiple treatments) meta-analysis. Here we provide a new model and…

Methodology · Statistics 2017-08-16 Dan Jackson , Sylwia Bujkiewicz , Martin Law , Richard D Riley , Ian White

Linear mixed effects are considered excellent predictors of cluster-level parameters in various domains. However, previous work has shown that their performance can be seriously affected by departures from modelling assumptions. Since the…

Methodology · Statistics 2022-07-27 Katarzyna Reluga , Stefan Sperlich

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

Databases in domains such as healthcare are routinely released to the public in aggregated form. Unfortunately, naive modeling with aggregated data may significantly diminish the accuracy of inferences at the individual level. This paper…

Machine Learning · Statistics 2016-05-17 Avradeep Bhowmik , Joydeep Ghosh , Oluwasanmi Koyejo

Linear regression without correspondences is the problem of performing a linear regression fit to a dataset for which the correspondences between the independent samples and the observations are unknown. Such a problem naturally arises in…

Machine Learning · Computer Science 2019-10-07 Manolis C. Tsakiris , Liangzu Peng , Aldo Conca , Laurent Kneip , Yuanming Shi , Hayoung Choi

Uncertainty is ubiquitous in real-world data, and the assumptions underlying classical linear regression models are often violated in practice. Inspired by the theory of sublinear expectation, we consider a linear regression model where the…

Statistics Theory · Mathematics 2026-04-28 Xifeng Li , Shuzhen Yang

This paper is devoted to the estimation of the shift parameter in a semiparametric regression model when the distribution of the observation times is unknown. Hence, we propose to use a stochastic algorithm which takes into account the…

Statistics Theory · Mathematics 2013-12-23 Philippe Fraysse

We consider a finite mixture model with varying mixing probabilities. Linear regression models are assumed for observed variables with coefficients depending on the mixture component the observed subject belongs to. A modification of the…

Probability · Mathematics 2016-01-07 Daryna Liubashenko , Rostyslav Maiboroda

This paper explores the validity of the two-stage estimation procedure for sparse linear models in high-dimensional settings with possibly many endogenous regressors. In particular, the number of endogenous regressors in the main equation…

Statistics Theory · Mathematics 2013-09-18 Ying Zhu

In this paper we study the asymptotics of linear regression in settings with non-Gaussian covariates where the covariates exhibit a linear dependency structure, departing from the standard assumption of independence. We model the covariates…

Machine Learning · Statistics 2024-12-10 Behrad Moniri , Hamed Hassani

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Subsampling is a computationally efficient and scalable method to draw inference in large data settings based on a subset of the data rather than needing to consider the whole dataset. When employing subsampling techniques, a crucial…

Methodology · Statistics 2025-10-08 Amalan Mahendran , Helen Thompson , James M. McGree