English
Related papers

Related papers: Semi-supervised linear regression with missing cov…

200 papers

We study the identification and estimation of statistical functionals of multivariate data missing non-monotonically and not-at-random, taking a semiparametric approach. Specifically, we assume that the missingness mechanism satisfies what…

Methodology · Statistics 2022-12-26 Daniel Malinsky , Ilya Shpitser , Eric J Tchetgen Tchetgen

This study investigates treatment effect estimation in the semi-supervised setting, also can be interpreted as prediction-powered inference. In our setting, we can use not only the standard triple of covariates, treatment indicator, and…

Machine Learning · Statistics 2026-05-05 Masahiro Kato

Semi-supervised datasets are ubiquitous across diverse domains where obtaining fully labeled data is costly or time-consuming. The prevalence of such datasets has consistently driven the demand for new tools and methods that exploit the…

Statistics Theory · Mathematics 2024-03-12 Ilmun Kim , Larry Wasserman , Sivaraman Balakrishnan , Matey Neykov

In linear models, omitting a covariate that is orthogonal to covariates in the model does not result in biased coefficient estimation. This in general does not hold for longitudinal data, where additional assumptions are needed to get…

Statistics Theory · Mathematics 2023-05-30 Zhuowei Sun , Hongyuan Cao , Li Chen , Jason P. Fine

Regression method has been widely used to explore relationship between dependent and independent variables. In practice, data issues such as censoring and missing data often exist. When the response variable is (fixed) censored, Tobit…

Methodology · Statistics 2021-07-06 Hailin Huang

We consider the problem of multivariate regression in a setting where the relevant predictors could be shared among different responses. We propose an algorithm which decomposes the coefficient matrix into the product of a long matrix and a…

Machine Learning · Statistics 2016-03-02 Milad Kharratzadeh , Mark Coates

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

Interval-censored competing risks data arise when each study subject may experience an event or failure from one of several causes and the failure time is not observed exactly but rather known to lie in an interval between two successive…

Methodology · Statistics 2016-03-02 Lu Mao , D. Y. Lin , Donglin Zeng

The problem of modeling the relationship between univariate distributions and one or more explanatory variables has found increasing interest. Traditional functional data methods cannot be applied directly to distributional data because of…

Methodology · Statistics 2025-02-04 Yidong Zhou , Hans-Georg Müller

In this paper we present the framework of symmetry in nonparametric regression. This generalises the framework of covariate sparsity, where the regression function depends only on at most $s < d$ of the covariates, which is a special case…

Statistics Theory · Mathematics 2024-04-22 Louis G. Christie , John A. D. Aston

In this paper, we introduce ``UniLasso'' -- a novel statistical method for sparse regression. This two-stage approach preserves the signs of the univariate coefficients and leverages their magnitude. Both of these properties are attractive…

Methodology · Statistics 2025-06-26 Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

Machine Learning · Computer Science 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

In this paper we revisit the risk bounds of the lasso estimator in the context of transductive and semi-supervised learning. In other terms, the setting under consideration is that of regression with random design under partial labeling.…

Statistics Theory · Mathematics 2016-11-09 Pierre C. Bellec , Arnak S. Dalalyan , Edwin Grappin , Quentin Paris

Sparse linear regression is a fundamental problem in high-dimensional statistics, but strikingly little is known about how to efficiently solve it without restrictive conditions on the design matrix. We consider the (correlated) random…

Machine Learning · Computer Science 2021-06-18 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

For semi-supervised techniques to be applied safely in practice we at least want methods to outperform their supervised counterparts. We study this question for classification using the well-known quadratic surrogate loss function. Using a…

Machine Learning · Statistics 2016-02-26 Jesse H. Krijthe , Marco Loog

Missing covariates in regression or classification problems can prohibit the direct use of advanced tools for further analysis. Recent research has realized an increasing trend towards the usage of modern Machine Learning algorithms for…

Machine Learning · Statistics 2022-03-23 Burim Ramosaj , Justus Tulowietzki , Markus Pauly

We study a regression model with a huge number of interacting variables. We consider a specific approximation of the regression function under two ssumptions: (i) there exists a sparse representation of the regression function in a…

Statistics Theory · Mathematics 2009-09-29 Peter J. Bickel , Ya'acov Ritov , Alexander B. Tsybakov

Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. A critical question remains unsettled; that is, is it possible…

Methodology · Statistics 2025-01-06 Xiaorui Zhu , Yichen Qin , Peng Wang

In many practical real-world applications, data missing is a very common phenomenon, making the development of data-driven artificial intelligence theory and technology increasingly difficult. Data completion is an important method for…

Machine Learning · Computer Science 2024-06-13 Xiaohua Pan , Weifeng Wu , Peiran Liu , Zhen Li , Peng Lu , Peijian Cao , Jianfeng Zhang , Xianfei Qiu , YangYang Wu

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally $\beta$-H\"{o}lder class with an exponentially decreasing tail,…

Statistics Theory · Mathematics 2020-09-01 Kyoungjae Lee , Minwoo Chae , Lizhen Lin