English
Related papers

Related papers: Compositional Correlation for Detecting Real Assoc…

200 papers

In this work, we propose an efficient two-stage algorithm solving a joint problem of correlation detection and partial alignment recovery between two Gaussian databases. Correlation detection is a hypothesis testing problem; under the null…

Information Theory · Computer Science 2023-05-26 Ran Tamir

In multivariate time series systems, key insights can be obtained by discovering lead-lag relationships inherent in the data, which refer to the dependence between two time series shifted in time relative to one another, and which can be…

Machine Learning · Statistics 2023-09-20 Yichi Zhang , Mihai Cucuringu , Alexander Y. Shestopaloff , Stefan Zohren

We apply Bayesian statistics to the estimation of correlation functions. We give the probability distributions of auto- and cross-correlations as functions of the data. Our procedure uses the measured data optimally and informs about the…

Data Analysis, Statistics and Probability · Physics 2022-12-27 Angel Gutierrez-Rubio , Juan S. Rojas-Arias , Jun Yoneda , Seigo Tarucha , Daniel Loss , Peter Stano

In this paper, a robust non-parametric measure of statistical dependence, or correlation, between two random variables is presented. The proposed coefficient is a permutation-like statistic that quantifies how much the observed sample S_n :…

Methodology · Statistics 2020-07-27 Rami Mahdi

Discovering causal relations among observed variables in a given data set is a main topic in studies of statistics and artificial intelligence. Recently, some techniques to discover an identifiable causal structure have been explored based…

Machine Learning · Computer Science 2012-02-20 Takanori Inazumi , Takashi Washio , Shohei Shimizu , Joe Suzuki , Akihiro Yamamoto , Yoshinobu Kawahara

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Understanding the relationships between different properties of data, such as whether a connectome or genome has information about disease status, is becoming increasingly important in modern biological datasets. While existing approaches…

Machine Learning · Statistics 2024-06-27 Joshua T. Vogelstein , Eric Bridgeford , Qing Wang , Carey E. Priebe , Mauro Maggioni , Cencheng Shen

Discovering causal relations from observational time series without making the stationary assumption is a significant challenge. In practice, this challenge is common in many areas, such as retail sales, transportation systems, and medical…

Machine Learning · Computer Science 2024-07-11 Shanyun Gao , Raghavendra Addanki , Tong Yu , Ryan A. Rossi , Murat Kocaoglu

Financial correlation matrices measure the unsystematic correlations between stocks. Such information is important for risk management. The correlation matrices are known to be ``noise dressed''. We develop a new and alternative method to…

Statistical Mechanics · Physics 2009-11-07 Thomas Guhr , Bernd Kaelber

Canonical correlation analysis (CCA) is a multivariate statistical method which describes the associations between two sets of variables. The objective is to find linear combinations of the variables in each data set having maximal…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Link prediction -- to identify potential missing or spurious links in temporal network data -- has typically been based on local structures, ignoring long-term temporal effects. In this chapter, we propose link-prediction methods based on…

Physics and Society · Physics 2023-11-27 Yueran Duan , Qing Guan , Petter Holme , Yacheng Yang , Wei Guan

Identifying the number of lags to include in an autoregressive model remains an open research problem due to the computational burden of treating it as a hyperparameter, especially in complex models. This study explores model-agnostic…

Methodology · Statistics 2025-09-09 Juan Pablo Montaño , Mario E. Arrieta-Prieto

This paper proposes a new paradigm and computational framework for identification of correspondences between sub-structures of distinct composite systems. For this, we define and investigate a variant of traditional data clustering, termed…

Machine Learning · Computer Science 2007-05-23 Zvika Marx , Ido Dagan , Joachim Buhmann

How does one find dimensions in multivariate data that are reliably expressed across repetitions? For example, in a brain imaging study one may want to identify combinations of neural signals that are reliably expressed across multiple…

Machine Learning · Statistics 2022-12-05 Lucas C. Parra , Stefan Haufe , Jacek P. Dmochowski

Canonical correlation analysis (CCA) is a widely used technique for estimating associations between two sets of multi-dimensional variables. Recent advancements in CCA methods have expanded their application to decipher the interactions of…

Machine Learning · Statistics 2025-02-05 Hongju Park , Shuyang Bai , Zhenyao Ye , Hwiyoung Lee , Tianzhou Ma , Shuo Chen

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

We present a novel approach to constraint-based causal discovery, that takes the form of straightforward logical inference, applied to a list of simple, logical statements about causal relations that are derived directly from observed…

Artificial Intelligence · Computer Science 2012-02-20 Tom Claassen , Tom Heskes

Discovering causal genetic variants from large genetic association studies poses many difficult challenges. Assessing which genetic markers are involved in determining trait status is a computationally demanding task, especially in the…

Genomics · Quantitative Biology 2015-04-09 Andrew L. Beam , Alison Motsinger-Reif , Jon Doyle

Compositional data represent a specific family of multivariate data, where the information of interest is contained in the ratios between parts rather than in absolute values of single parts. The analysis of such specific data is…

Genome-wide association studies (GWAS) have emerged as a rich source of genetic clues into disease biology, and they have revealed strong genetic correlations among many diseases and traits. Some of these genetic correlations may reflect…

Methodology · Statistics 2018-11-28 Luke J. O'Connor , Alkes L. Price