English
Related papers

Related papers: Multidimensional mutual information methods for th…

200 papers

We propose Cooperative Component Analysis (CoCA), a new method for unsupervised multi-view analysis: it identifies the component that simultaneously captures significant within-view variance and exhibits strong cross-view correlation. The…

Methodology · Statistics 2024-07-25 Daisy Yi Ding , Alden Green , Min Woo Sun , Robert Tibshirani

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good…

Quantitative Methods · Quantitative Biology 2019-08-14 Caroline M. Holmes , Ilya Nemenman

The product moment covariance is a cornerstone of multivariate data analysis, from which one can derive correlations, principal components, Mahalanobis distances and many other results. Unfortunately the product moment covariance and the…

Methodology · Statistics 2021-05-21 Jakob Raymaekers , Peter J. Rousseeuw

Data mining, particularly the analysis of multivariate time series data, plays a crucial role in extracting insights from complex systems and supporting informed decision-making across diverse domains. However, assessing the similarity of…

Machine Learning · Computer Science 2025-07-15 Franck Tonle , Henri Tonnang , Milliam Ndadji , Maurice Tchendji , Armand Nzeukou , Kennedy Senagi , Saliou Niassy

In this paper, we analyze the behavior of the multivariate symmetric uncertainty (MSU) measure through the use of statistical simulation techniques under various mixes of informative and non-informative randomly generated features.…

Machine Learning · Computer Science 2023-06-29 Gustavo Sosa-Cabrera , Miguel García-Torres , Santiago Gómez , Christian Schaerer , Federico Divina

Sequence-based protein homology detection has been extensively studied and so far the most sensitive method is based upon comparison of protein sequence profiles, which are derived from multiple sequence alignment (MSA) of sequence homologs…

Quantitative Methods · Quantitative Biology 2015-06-18 Jianzhu Ma , Sheng Wang , Zhiyong Wang , Jinbo Xu

This paper investigates an error covariance matrix splitting technique for multiuser multiple input and multiple output (MIMO) interference downlink channel. Most of the related work has thus far considered the traditional error covariance…

Information Theory · Computer Science 2016-09-06 Md. Abdul Latif Sarker

Mechanistic Interpretability (MI) aims to reverse-engineer model behaviors by identifying functional sub-networks. Yet, the scientific validity of these findings depends on their stability. In this work, we argue that circuit discovery is…

Machine Learning · Computer Science 2026-02-04 Maxime Méloux , François Portet , Maxime Peyrard

Understanding the interplay between high-dimensional data from different views is essential in biomedical research, particularly in fields such as genomics, neuroimaging and biobank-scale studies involving high-dimensional features.…

Methodology · Statistics 2026-03-31 Ruyi Pan , Yinqiu He , Jun Young Park

Identifying protein-protein interactions is crucial for a systems-level understanding of the cell. Recently, algorithms based on inverse statistical physics, e.g. Direct Coupling Analysis (DCA), have allowed to use evolutionarily related…

Biomolecules · Quantitative Biology 2020-03-25 Carlos A. Gandarilla-Pérez , Pierre Mergny , Martin Weigt , Anne-Florence Bitbol

We study the covariance of the cross-power spectrum of different tracers for the large-scale structure. We develop the counts-in-cells framework for the multi-tracer approach, and use this to derive expressions for the full non-Gaussian…

Astrophysics · Physics 2015-05-13 Robert E. Smith

Multivariate Analysis (MVA) comprises a family of well-known methods for feature extraction which exploit correlations among input variables representing the data. One important property that is enjoyed by most such methods is uncorrelation…

Machine Learning · Computer Science 2021-12-24 Sergio Muñoz-Romero , Vanessa Gómez-Verdejo , Jerónimo Arenas-García

This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the number of marginally…

Machine Learning · Statistics 2025-06-11 Cencheng Shen , Yuexiao Dong

In network meta-analysis (NMA), we synthesize all relevant evidence about health outcomes with competing treatments. The evidence may come from randomized controlled trials (RCT) or non-randomized studies (NRS) as individual participant…

Microarray studies, in order to identify genes associated with an outcome of interest, usually produce noisy measurements for a large number of gene expression features from a small number of subjects. One common approach to analyzing such…

Methodology · Statistics 2021-04-21 Linh Nghiem , Francis K. C. Hui , Samuel Mueller , A. H. Welsh

Real-space mutual information (RSMI) was shown to be an important quantity, formally and from a numerical standpoint, in finding coarse-grained descriptions of physical systems. It very generally quantifies spatial correlations, and can…

Statistical Mechanics · Physics 2021-12-09 Doruk Efe Gökmen , Zohar Ringel , Sebastian D. Huber , Maciej Koch-Janusz

Global coevolutionary models of homologous protein families, as constructed by direct coupling analysis (DCA), have recently gained popularity in particular due to their capacity to accurately predict residue-residue contacts from sequence…

Quantitative Methods · Quantitative Biology 2019-09-23 Matteo Figliuzzi , Pierre Barrat-Charlaix , Martin Weigt

We extend multi-way, multivariate ANOVA-type analysis to cases where one covariate is the view, with features of each view coming from different, high-dimensional domains. The different views are assumed to be connected by having paired…

Machine Learning · Statistics 2009-12-17 Ilkka Huopaniemi , Tommi Suvitaival , Janne Nikkilä , Matej Orešič , Samuel Kaski

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

We define a metric, mutual information in frequency (MI-in-frequency), to detect and quantify the statistical dependence between different frequency components in the data, referred to as cross-frequency coupling and apply it to…

Neurons and Cognition · Quantitative Biology 2018-05-23 Rakesh Malladi , Don H Johnson , Giridhar P Kalamangalam , Nitin Tandon , Behnaam Aazhang