English
Related papers

Related papers: Regression with missing Ys: An improved strategy f…

200 papers

Time series are widely used as signals in many classification/regression tasks. It is ubiquitous that time series contains many missing values. Given multiple correlated time series data, how to fill in missing values and to predict their…

Machine Learning · Computer Science 2018-05-29 Wei Cao , Dong Wang , Jian Li , Hao Zhou , Lei Li , Yitan Li

This paper studies the problem of multivariate linear regression where a portion of the observations is grossly corrupted or is missing, and the magnitudes and locations of such occurrences are unknown in priori. To deal with this problem,…

Machine Learning · Statistics 2017-01-12 Xiaowei Zhang , Chi Xu , Yu Zhang , Tingshao Zhu , Li Cheng

In many fields, and especially in the medical and social sciences and in recommender systems, data are gathered through clinical studies or targeted surveys. Participants are generally reluctant to respond to all questions in a survey or…

Statistics Theory · Mathematics 2016-11-15 Mohammad Reza Gholami , Magnus Jansson , Erik G. Ström , Ali H. Sayed

In this article, we consider an imputation method to handle missing response values based on semiparametric quantile regression estimation. In the proposed method, the missing response values are generated using the estimated conditional…

Statistics Theory · Mathematics 2014-04-15 Senniang Chen , Cindy L Yu

The Ising model has become a popular psychometric model for analyzing item response data. The statistical inference of the Ising model is typically carried out via a pseudo-likelihood, as the standard likelihood approach suffers from a high…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

Ecological Momentary Assessments (EMA) capture real-time thoughts and behaviors in natural settings, producing rich longitudinal data for statistical and physiological analyses. However, the robustness of these analyses can be compromised…

Methodology · Statistics 2023-11-21 Yiheng Wei , Donald Hedeker

Many datasets suffer from missing values due to various reasons,which not only increases the processing difficulty of related tasks but also reduces the accuracy of classification. To address this problem, the mainstream approach is to use…

Machine Learning · Computer Science 2024-08-14 Cong Guo , Chun Liu , Wei Yang

Time-series data with missing values are commonly encountered in many fields, such as healthcare, meteorology, and robotics. The imputation aims to fill the missing values with valid values. Most imputation methods trained the models…

Machine Learning · Computer Science 2024-11-21 Tae-Min Choi , Ji-Su Kang , Jong-Hwan Kim

Multiple imputation is widely used to handle missing data. Although Rubin's combining rule is simple, it is not clear whether or not the standard multiple imputation inference is consistent when coupled with the commonly-used full sample…

Methodology · Statistics 2023-01-03 Qian Guan , Shu Yang

Consider the problem of imputing missing values in a dataset. One the one hand, conventional approaches using iterative imputation benefit from the simplicity and customizability of learning conditional distributions directly, but suffer…

Machine Learning · Statistics 2022-06-17 Daniel Jarrett , Bogdan Cebere , Tennison Liu , Alicia Curth , Mihaela van der Schaar

Missing data estimation is an important challenge with high-dimensional data arranged in the form of a matrix. Typically this data matrix is transposable, meaning that either the rows, columns or both can be treated as features. To model…

Applications · Statistics 2010-11-10 Genevera I. Allen , Robert Tibshirani

Missing data is a common problem in clinical data collection, which causes difficulty in the statistical analysis of such data. In this article, we consider the problem under a framework of a semiparametric partially linear model when…

Methodology · Statistics 2022-06-13 Zishu Zhan , Xiangjie Li , Jingxiao Zhang

Data from discovery proteomic and phosphoproteomic experiments typically include missing values that correspond to proteins that have not been identified in the analyzed sample. Replacing the missing values with random numbers, a process…

Quantitative Methods · Quantitative Biology 2019-10-01 Matus Medo , Daniel M. Aebersold , Michaela Medova

Simulation-based inference (SBI) methods typically require fully observed data to infer parameters of models with intractable likelihood functions. However, datasets often contain missing values due to incomplete observations, data…

Machine Learning · Computer Science 2025-03-04 Yogesh Verma , Ayush Bharti , Vikas Garg

Rule models are often preferred in prediction tasks with tabular inputs as they can be easily interpreted using natural language and provide predictive performance on par with more complex models. However, most rule models' predictions are…

Machine Learning · Computer Science 2023-11-27 Lena Stempfle , Fredrik D. Johansson

Modern datasets commonly feature both substantial missingness and many variables of mixed data types, which present significant challenges for estimation and inference. Complete case analysis, which proceeds using only the observations with…

Methodology · Statistics 2023-04-10 Joseph Feldman , Daniel R. Kowal

Many real-world datasets contain missing entries and mixed data types including categorical and ordered (e.g. continuous and ordinal) variables. Imputing the missing entries is necessary, since many data analysis pipelines require complete…

Methodology · Statistics 2022-10-14 Yuxuan Zhao , Alex Townsend , Madeleine Udell

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

Constant (naive) imputation is still widely used in practice as this is a first easy-to-use technique to deal with missing data. Yet, this simple method could be expected to induce a large bias for prediction purposes, as the imputed input…

Statistics Theory · Mathematics 2024-02-07 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

We characterize the structure and origins of missingness for 159 cross-sectional return predictors and study missing value handling for portfolios constructed using machine learning. Simply imputing with cross-sectional means performs well…

Methodology · Statistics 2024-01-15 Andrew Y. Chen , Jack McCoy