English
Related papers

Related papers: R-miss-tastic: a unified platform for missing valu…

200 papers

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

While data are the primary fuel for machine learning models, they often suffer from missing values, especially when collected in real-world scenarios. However, many off-the-shelf machine learning models, including artificial neural network…

Nonignorable missing data, where the probability of missingness depends on unobserved values, presents a significant challenge in statistical analysis. Traditional methods often rely on strong parametric assumptions that are difficult to…

Methodology · Statistics 2025-09-19 Yujie Zhao

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Sensor data streams occur widely in various real-time applications in the context of the Internet of Things (IoT). However, sensor data streams feature missing values due to factors such as sensor failures, communication errors, or depleted…

Databases · Computer Science 2023-11-15 Xiao Li , Huan Li , Hua Lu , Christian S. Jensen , Varun Pandey , Volker Markl

Time series data are observations collected over time intervals. Successful analysis of time series data captures patterns such as trends, cyclicity and irregularity, which are crucial for decision making in research, business, and…

Machine Learning · Computer Science 2023-08-21 Daniel Zhang

R is a language and environment for statistical computing and graphics, which provides a wide variety of statistical tools (modeling, statistical testing, time series analysis, classification problems, machine learning, ...), together with…

Other Statistics · Statistics 2023-06-22 M. Isabel Parra , Eva L. Sanjuán , M. Carmen Robustillo , Mario M. Pizarro

Learning structures between groups of variables from data with missing values is an important task in the real world, yet difficult to solve. One typical scenario is discovering the structure among topics in the education domain to identify…

Imputation methods for dealing with incomplete data typically assume that the missingness mechanism is at random (MAR). These methods can also be applied to missing not at random (MNAR) situations, where the user specifies some adjustment…

Methodology · Statistics 2024-04-24 Shahab Jolani , Stef van Buuren

Clinical prediction models must be developed using sufficiently large datasets to minimise overfitting and ensure robust predictive performance. Existing sample size calculations assume complete predictor data for all included participants,…

The estimation of missing input vector elements in real time processing applications requires a system that possesses the knowledge of certain characteristics such as correlations between variables, which are inherent in the input space.…

Applications · Statistics 2007-05-23 Fulufhelo V. Nelwamondo , Shakir Mohamed , Tshilidzi Marwala

Boosting has emerged as a useful machine learning technique over the past three decades, attracting increased attention. Most advancements in this area, however, have primarily focused on numerical implementation procedures, often lacking…

Methodology · Statistics 2026-02-23 Yuan Bian , Grace Y. Yi , Wenqing He

Methods to handle missing data have been extensively explored in the context of estimation and descriptive studies, with multiple imputation being the most widely used method in clinical research. However, in the context of clinical risk…

Methodology · Statistics 2024-11-25 Junhui Mi , Rahul D. Tendulkar , Sarah M. C. Sittenfeld , Sujata Patil , Emily C. Zabor

Imagine a website that asks the user to fill in a web form and -- based on the input values -- derives a relevant figure, for instance an expected salary, a medical diagnosis or the market value of a house. How to deal with missing input…

Human-Computer Interaction · Computer Science 2015-12-11 Michael Mayer , Dominic van der Zypen

Lack of reliability is a well-known issue for reinforcement learning (RL) algorithms. This problem has gained increasing attention in recent years, and efforts to improve it have grown substantially. To aid RL researchers and production…

Machine Learning · Statistics 2020-02-14 Stephanie C. Y. Chan , Samuel Fishman , John Canny , Anoop Korattikara , Sergio Guadarrama

Missing data can lead to inefficiencies and biases in analyses, in particular when data are missing not at random (MNAR). It is thus vital to understand and correctly identify the missing data mechanism. Recovering missing values through a…

Methodology · Statistics 2022-12-08 Jack Noonan , Adetola Adedamola Adediran , Robin Mitra , Stefanie Biedermann

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

Assessing the quality and impact of individual data points is critical for improving model performance and mitigating undesirable biases within the training dataset. Several data valuation algorithms have been proposed to quantify data…

Machine Learning · Computer Science 2023-10-16 Kevin Fu Jiang , Weixin Liang , James Zou , Yongchan Kwon

The ubiquity of missing data in urban intelligence systems, attributable to adverse environmental conditions and equipment failures, poses a significant challenge to the efficacy of downstream applications, notably in the realms of traffic…

Machine Learning · Computer Science 2026-05-25 Songyu Ke , Chenyu Wu , Yuxuan Liang , Huiling Qin , Junbo Zhang , Yu Zheng

Missing data is pervasive in econometric applications, and rarely is it plausible that the data are missing (completely) at random. This paper proposes a methodology for studying the robustness of results drawn from incomplete datasets.…

Econometrics · Economics 2025-12-29 Daniel Ober-Reynolds