English
Related papers

Related papers: Discovering Potential Correlations via Hypercontra…

200 papers

Detecting the components common or correlated across multiple data sets is challenging due to a large number of possible correlation structures among the components. Even more challenging is to determine the precise structure of these…

Information Theory · Computer Science 2019-02-01 Tanuj Hasija , Christian Lameiro , Timothy Marrinan , Peter J. Schreier

The Bell inequalities in three and four correlations are re-derived in general forms showing that three and four data sets, respectively, identically satisfy them regardless of whether they are random, deterministic, measured, predicted, or…

Quantum Physics · Physics 2020-06-24 Louis Sica

Motivated by differential co-expression analysis in genomics, we consider in this paper estimation and testing of high-dimensional differential correlation matrices. An adaptive thresholding procedure is introduced and theoretical…

Methodology · Statistics 2015-10-22 T. Tony Cai , Anru Zhang

High-dimensional phenotypes hold promise for richer findings in association studies, but testing of several phenotype traits aggravates the grand challenge of association studies, that of multiple testing. Several methods have recently been…

Methodology · Statistics 2013-05-14 Pekka Marttinen , Jussi Gillberg , Aki Havulinna , Jukka Corander , Samuel Kaski

Suppose (standardized) measurements or statistics are monitored to raise an alarm when a threshold is exceeded. Often, the underlying population is heterogenous with respect to important discrete variables and thus samples may consist of…

Statistics Theory · Mathematics 2025-10-10 Ansgar Steland

Many applications of causal inference require using treatment effects estimated on a study population to make decisions in a separate target population. We consider the challenging setting where there are covariates that are observed in the…

Machine Learning · Computer Science 2024-10-22 Khurram Yamin , Vibhhu Sharma , Ed Kennedy , Bryan Wilder

Causal knowledge is vital for effective reasoning in science, as causal relations, unlike correlations, allow one to reason about the outcomes of interventions. Algorithms that can discover causal relations from observational data are based…

Machine Learning · Statistics 2019-11-12 Anish Dhir , Ciarán M. Lee

It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the…

Machine Learning · Computer Science 2023-01-02 Hadis Anahideh , Nazanin Nezami , Abolfazl Asudeh

There has been increasing interest in recent years in the development of approaches to estimate causal effects when the number of potential confounders is prohibitively large. This growth in interest has led to a number of potential…

Methodology · Statistics 2020-02-05 Joseph Antonelli , Matthew Cefalu

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in…

Methodology · Statistics 2024-05-03 Mingzhou Liu , Xinwei Sun , Yu Qiao , Yizhou Wang

Distance covariance is a widely used statistical methodology for testing the dependency between two groups of variables. Despite the appealing properties of consistency and superior testing power, the testing results of distance covariance…

Methodology · Statistics 2026-03-20 Andi Wang , Hao Yan , Juan Du

Estimating the causal effect of a treatment or health policy with observational data can be challenging due to an imbalance of and a lack of overlap between treated and control covariate distributions. In the presence of limited overlap,…

Methodology · Statistics 2025-03-24 Martha Barnard , Jared D. Huling , Julian Wolfson

Providing effective guidance for users has long been an important and challenging task for efficient exploratory visual analytics, especially when selecting variables for visualization in high-dimensional datasets. Correlation is the most…

Human-Computer Interaction · Computer Science 2024-10-18 Arran Zeyu Wang , David Borland , David Gotz

Group testing, a problem with diverse applications across multiple disciplines, traditionally assumes independence across nodes' states. Recent research, however, focuses on real-world scenarios that often involve correlations among nodes,…

Information Theory · Computer Science 2025-04-02 Hesam Nikpey , Saswati Sarkar , Shirin Saeedi Bidokhti

This paper proposes a class of estimators for population correlation coefficient when information about the population mean and population variance of one of the variables is not available but information about these parameters of another…

General Mathematics · Mathematics 2007-05-23 M. Khoshnevisan , F. Kaymarm , H. P. Singh , Rajesh Singh , Florentin Smarandache

Ascertaining causal direction from observational data is a fundamental challenge in scientific inquiry. Of particular interest is the problem of covariate-adjusted bivariate causal discovery, i.e., determining the causal direction between X…

Methodology · Statistics 2025-07-30 Soumik Purkayastha , Peter X. -K. Song

Experimentally observed networks of interacting dynamical systems are inferred from recorded multivariate time series by evaluating a statistical measure of dependence, usually the cross-correlation coefficient, or mutual information. These…

Data Analysis, Statistics and Probability · Physics 2017-07-03 Milan Palus

We propose a method to distinguish causal influence from hidden confounding in the following scenario: given a target variable Y, potential causal drivers X, and a large number of background features, we propose a novel criterion for…

Machine Learning · Statistics 2022-02-07 You-Lin Chen , Lenon Minorics , Dominik Janzing

The estimation of the correlation between time series is often hampered by the asynchronicity of the signals. Cumulating data within a time window suppresses this source of noise but weakens the statistics. We present a method to estimate…

Data Analysis, Statistics and Probability · Physics 2009-02-18 Bence Toth , Janos Kertesz

Suppose an experiment is conducted on pairs of objects with outcome responses a continuous variable measuring the interactions among the pairs. Furthermore, assume the response variable is hard to measure numerically but easy to be coded…

Methodology · Statistics 2015-05-11 Abdul-Hamid Al-Ibrahim