English
Related papers

Related papers: Correlation visualization under missing values: a …

200 papers

This paper contributes a novel visualization method, Missingness Glyph, for analysis and exploration of missing values in data. Missing values are a common challenge in most data generating domains and may cause a range of analysis issues.…

Graphics · Computer Science 2025-05-28 Sara Johansson Fernstad , Jimmy Johansson

We propose estimation methods for change points in high-dimensional covariance structures with an emphasis on challenging scenarios with missing values. We advocate three imputation like methods and investigate their implications on common…

Machine Learning · Statistics 2020-10-26 Malte Londschien , Solt Kovács , Peter Bühlmann

Many applications collect a large number of time series, for example, the financial data of companies quoted in a stock exchange, the health care data of all patients that visit the emergency room of a hospital, or the temperature sequences…

Information Theory · Computer Science 2017-02-09 Jonathan Mei , José M. F. Moura

"Correlation does not imply causation" is a famous mantra in statistical and visual analysis. However, consumers of visualizations often draw causal conclusions when only correlations between variables are shown. In this paper, we…

Human-Computer Interaction · Computer Science 2024-10-18 Arran Zeyu Wang , David Borland , Tabitha C. Peck , Wenyuan Wang , David Gotz

Background: Existing guidelines for handling missing data are generally not consistent with the goals of prediction modelling, where missing data can occur at any stage of the model pipeline. Multiple imputation (MI), often heralded as the…

Methodology · Statistics 2022-06-27 Rose Sisk , Matthew Sperrin , Niels Peek , Maarten van Smeden , Glen P. Martin

A useful technique for analyzing incomplete tables is to model the missing data mechanisms of the variables using log-linear models. In this paper, we use log-linear parametrization and propose estimation methods for arbitrary three-way and…

Methodology · Statistics 2019-10-29 S. Ghosh , P. Vellaisamy

Given the prevalence of missing data in modern statistical research, a broad range of methods is available for any given imputation task. How does one choose the `best' imputation method in a given application? The standard approach is to…

Applications · Statistics 2022-12-01 Jeffrey Näf , Meta-Lina Spohn , Loris Michel , Nicolai Meinshausen

Data mining and machine learning techniques such as classification and regression trees (CART) represent a promising alternative to conventional logistic regression for propensity score estimation. Whereas incomplete data preclude the…

Machine Learning · Statistics 2018-07-26 Bas B. L. Penning de Vries , Maarten van Smeden , Rolf H. H. Groenwold

Data imputation is the most popular method of dealing with missing values, but in most real life applications, large missing data can occur and it is difficult or impossible to evaluate whether data has been imputed accurately (lack of…

An approach to amputation, the process of introducing missing values to a complete dataset, is presented. It allows to construct missingness indicators in a flexible and principled way via copulas and Bernoulli margins and to incorporate…

Applications · Statistics 2025-07-28 Marius Hofert , James Jackson , Niels Hagenbuch

We introduce the concept of pattern graphs--directed acyclic graphs representing how response patterns are associated. A pattern graph represents an identifying restriction that is nonparametrically identified/saturated and is often a…

Methodology · Statistics 2020-12-04 Yen-Chi Chen

Missing data is a systemic problem in practical scenarios that causes noise and bias when estimating treatment effects. This makes treatment effect estimation from data with missingness a particularly tricky endeavour. A key reason for this…

Machine Learning · Statistics 2023-02-27 Jeroen Berrevoets , Fergus Imrie , Trent Kyono , James Jordon , Mihaela van der Schaar

We consider the statistical properties of interaction parameter estimates obtained by the direct coupling analysis (DCA) approach to learning interactions from large data sets. Assuming that the data are generated from a random background…

Data Analysis, Statistics and Probability · Physics 2017-04-07 Yingying Xu , Erik Aurell , Jukka Corander , Yoshiyuki Kabashima

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

Uncoupled regression is the problem to learn a model from unlabeled data and the set of target values while the correspondence between them is unknown. Such a situation arises in predicting anonymized targets that involve sensitive…

Machine Learning · Computer Science 2019-06-04 Liyuan Xu , Junya Honda , Gang Niu , Masashi Sugiyama

Complete randomization allows for consistent estimation of the average treatment effect based on the difference in means of the outcomes without strong modeling assumptions on the outcome-generating process. Appropriate use of the…

Methodology · Statistics 2021-08-03 Anqi Zhao , Peng Ding

Visualizing network data is applicable in domains such as biology, engineering, and social sciences. We report the results of a study comparing the effectiveness of the two primary techniques for showing network data: node-link diagrams and…

Human-Computer Interaction · Computer Science 2017-09-04 Mershack Okoe , Radu Jianu , Stephen Kobourov

With the increasing availability of high-dimensional data, analysts often rely on exploratory data analysis to understand complex data sets. A key approach to exploring such data is dimensionality reduction, which embeds high-dimensional…

Machine Learning · Computer Science 2024-12-17 Pavlin G. Poličar , Blaž Zupan

An important goal across most scientific fields is the discovery of causal structures underling a set of observations. Unfortunately, causal discovery methods which are based on correlation or mutual information can often fail to identify…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Despite the growing interest in causal and statistical inference for settings with data dependence, few methods currently exist to account for missing data in dependent data settings; most classical missing data methods in statistics and…

‹ Prev 1 4 5 6 7 8 10 Next ›