English
Related papers

Related papers: Direct coupling information measure from non-unifo…

200 papers

Although deep learning models have driven state-of-the-art performance on a wide array of tasks, they are prone to spurious correlations that should not be learned as predictive clues. To mitigate this problem, we propose a causality-based…

Machine Learning · Computer Science 2021-10-27 Xinyi Wang , Wenhu Chen , Michael Saxon , William Yang Wang

Maximal correlation is a measure of correlation for bipartite distributions. This measure has two intriguing features: (1) it is monotone under local stochastic maps; (2) it gives the same number when computed on i.i.d. copies of a pair of…

Quantum Physics · Physics 2017-01-12 Salman Beigi

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

Data association, the reasoning over correspondence between targets and measurements, is a problem of fundamental importance in target tracking. Recently, belief propagation (BP) has emerged as a promising method for estimating the marginal…

Artificial Intelligence · Computer Science 2018-01-25 Jason L. Williams , Roslyn A. Lau

Matching in causal inference from observational data aims to construct treatment and control groups with similar distributions of covariates, thereby reducing confounding and ensuring an unbiased estimation of treatment effects. This…

Artificial Intelligence · Computer Science 2025-04-15 Sahil Shikalgar , Md. Noor-E-Alam

This tutorial provides a worked example of using Dynamic Causal Modelling (DCM) and Parametric Empirical Bayes (PEB) to characterise inter-subject variability in neural circuitry (effective connectivity). This involves specifying a…

Quantitative Methods · Quantitative Biology 2019-07-15 Peter Zeidman , Amirhossein Jafarian , Mohamed L. Seghier , Vladimir Litvak , Hayriye Cagnan , Cathy J. Price , Karl J. Friston

Convergent Cross-Mapping (CCM) has shown high potential to perform causal inference in the absence of models. We assess the strengths and weaknesses of the method by varying coupling strength and noise levels in coupled logistic maps. We…

Chaotic Dynamics · Physics 2018-10-19 Dan Mønster , Riccardo Fusaroli , Kristian Tylén , Andreas Roepstorff , Jacob F. Sherson

In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Tristan Sylvain , Francis Dutil , Tess Berthier , Lisa Di Jorio , Margaux Luck , Devon Hjelm , Yoshua Bengio

Knowledge about existence, strength, and dominant direction of causal influences is of paramount importance for understanding complex systems. With limited amounts of realistic data, however, current methods for investigating causal links…

Data Analysis, Statistics and Probability · Physics 2020-10-20 Erik Laminski , Klaus R. Pawelzik

Measuring transport coefficients at the microscale remains challenging, often relying on indirect methods that require modeling and calibration. This Letter derives universal asymptotic forms for the autocorrelation and relative uncertainty…

Statistical Mechanics · Physics 2025-05-09 Omer Granek

Physics-informed machine learning (PIML) integrates prior physical information, often in the form of differential equation constraints, into the process of fitting machine learning models to physical data. Popular PIML approaches, including…

Machine Learning · Statistics 2025-10-31 Mara Daniels , Liam Hodgkinson , Michael Mahoney

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

We develop a new statistical method for estimating functional connectivity between neurophysiological signals represented by a multivariate time series. We use partial coherence as the measure of functional connectivity. Partial coherence…

Applications · Statistics 2011-08-17 Mark Fiecas , Hernando Ombao

In this article we present very intuitive, easy to follow, yet mathematically rigorous, approach to the so called data fitting process. Rather than minimizing the distance between measured and simulated data points, we prefer to find such…

Data Analysis, Statistics and Probability · Physics 2017-08-07 Marek W. Gutowski

Background: Functional magnetic resonance imaging (fMRI) provides non-invasive measures of neuronal activity using an endogenous Blood Oxygenation-Level Dependent (BOLD) contrast. This article introduces a nonlinear dimensionality reduction…

Image and Video Processing · Electrical Eng. & Systems 2019-12-09 Gagan Sidhu

Indirect comparisons of treatment-specific outcomes across separate studies often inform decision-making in the absence of head-to-head randomized comparisons. Differences in baseline characteristics between study populations may introduce…

Applications · Statistics 2020-04-09 David Cheng , Rajeev Ayyagari , James Signorovitch

We present extensive new ab initio path integral Monte Carlo (PIMC) results for an electron gas at warm dense matter conditions that is subject to multiple harmonic perturbations. In addition to the previously investigated nonlinear effects…

Plasma Physics · Physics 2021-10-26 Tobias Dornheim , Jan Vorberger , Zhandos Moldabekov , Michael Bonitz

Over the last years, word and sentence embeddings have established as text preprocessing for all kinds of NLP tasks and improved the performances significantly. Unfortunately, it has also been shown that these embeddings inherit various…

Computation and Language · Computer Science 2024-09-13 Sarah Schröder , Alexander Schulz , Philip Kenneweg , Robert Feldhans , Fabian Hinder , Barbara Hammer

The pointwise mutual information profile, or simply profile, is the distribution of pointwise mutual information for a given pair of random variables. One of its important properties is that its expected value is precisely the mutual…

Machine Learning · Statistics 2024-05-30 Paweł Czyż , Frederic Grabowski , Julia E. Vogt , Niko Beerenwinkel , Alexander Marx

Mutual Information (MI) plays an important role in representation learning. However, MI is unfortunately intractable in continuous and high-dimensional settings. Recent advances establish tractable and scalable MI estimators to discover…

Machine Learning · Statistics 2020-05-05 Liangjian Wen , Yiji Zhou , Lirong He , Mingyuan Zhou , Zenglin Xu