English
Related papers

Related papers: Coping with Selection Effects: A Primer on Regress…

200 papers

In this article, we introduce a new variable selection technique through trimming for finite mixture of regression models. Compared to the traditional variable selection techniques, the new method is robust and not sensitive to outliers.…

Methodology · Statistics 2019-05-06 Sijia Xiang , Weixin Yao

Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even…

Methodology · Statistics 2024-09-17 Hanmei Sun , Jiangshan Zhang , Jiming Jiang

Cook's distance [Technometrics 19 (1977) 15-18] is one of the most important diagnostic tools for detecting influential individual or subsets of observations in linear regression for cross-sectional data. However, for many complex data…

Methodology · Statistics 2012-06-08 Hongtu Zhu , Joseph G. Ibrahim , Hyunsoon Cho

The problem of measuring conditional dependence between two random phenomena arises when a third one (a confounder) has a potential influence on the amount of information between them. A typical issue in this challenging problem is the…

Machine Learning · Statistics 2025-03-12 Ferran de Cabrera , Marc Vilà-Insa , Jaume Riba

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

We investigate methods for penalized regression in the presence of missing observations. This paper introduces a method for estimating the parameters which compensates for the missing observations. We first, derive an unbiased estimator of…

Applications · Statistics 2013-10-09 Yunjin Choi , Robert Tibshirani

In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary…

Methodology · Statistics 2021-12-14 Siegfried Hörmann , Fatima Jammoul

In this paper, we study high-dimensional estimation from truncated samples. We focus on two fundamental and classical problems: (i) inference of sparse Gaussian graphical models and (ii) support recovery of sparse linear models. (i) For…

Machine Learning · Statistics 2020-06-18 Arnab Bhattacharyya , Rathin Desai , Sai Ganesh Nagarajan , Ioannis Panageas

Given only data generated by a standard confounding graph with unobserved confounder, the Average Treatment Effect (ATE) is not identifiable. To estimate the ATE, a practitioner must then either (a) collect deconfounded data;(b) run a…

Machine Learning · Statistics 2021-03-09 Kyra Gan , Andrew A. Li , Zachary C. Lipton , Sridhar Tayur

Clever sampling methods can be used to improve the handling of big data and increase its usefulness. The subject of this study is remote sensing, specifically airborne laser scanning point clouds representing different classes of ground…

Machine Learning · Statistics 2014-09-17 Ronald Hochreiter , Christoph Waldhauser

A common problem faced by statistical institutes is that data may be missing from collected data sets. The typical way to overcome this problem is to impute the missing data. The problem of imputing missing data is complicated by the fact…

Applications · Statistics 2014-01-09 Jeroen Pannekoek , Natalie Shlomo , Ton De Waal

Prior proposals for cumulative statistics suggest making tiny random perturbations to the scores (independent variables in a regression) in order to ensure the scores' uniqueness. Uniqueness means that no score for any member of the…

Methodology · Statistics 2022-08-23 Mark Tygert

Biased sampling designs can be highly efficient when studying rare (binary) or low variability (continuous) endpoints. We consider longitudinal data settings in which the probability of being sampled depends on a repeatedly measured…

We address the problem of one dimensional segment detection and estimation, in a regression setup. At each point of a fixed or random design, one observes whether that point belongs to the unknown segment or not, up to some additional…

Statistics Theory · Mathematics 2014-04-25 Victor-Emmanuel Brunel

Semicontinuous outcomes commonly arise in a wide variety of fields, such as insurance claims, healthcare expenditures, rainfall amounts, and alcohol consumption. Regression models, including Tobit, Tweedie, and two-part models, are widely…

Methodology · Statistics 2024-03-26 Lu Yang

A finite set is "hidden" if its elements are not directly enumerable or if its size cannot be ascertained via a deterministic query. In public health, epidemiology, demography, ecology and intelligence analysis, researchers have developed a…

Statistics Theory · Mathematics 2019-10-17 Si Cheng , Daniel J. Eck , Forrest W. Crawford

The analysis of a truncated sample can be hindered by censoring. Survival information may be lost to follow-up or the birthdate may be missing. The data can still be modeled as a truncated point process and it is close to a Poisson process,…

Methodology · Statistics 2025-08-12 Fiete Sieg , Anne-Marie Toparkus , Rafael Weissbach

In Astronomy, Survival Analysis and Epidemiology, among many other fields, doubly truncated data often appear. Double truncation generally induces a sampling bias, so ordinary estimators may be inconsistent. In this paper, smoothing spline…

Methodology · Statistics 2026-01-15 David Bamio , Jacobo de Uña-Álvarez

Incorporating constraints is a major concern in probabilistic machine learning. A wide variety of problems require predictions to be integrated with reasoning about constraints, from modelling routes on maps to approving loan predictions.…

Machine Learning · Computer Science 2020-01-31 Ioannis Papantonis , Vaishak Belle

Whether a variable is the cause of another, or simply associated with it, is often an important scientific question. Causal Inference is the name associated with the body of techniques for addressing that question in a statistical setting.…

Applications · Statistics 2025-06-25 Caren Marzban , Yikun Zhang , Nicholas Bond , Michael Richman