English
Related papers

Related papers: Direct coupling information measure from non-unifo…

200 papers

Time series datasets often contain heterogeneous signals, composed of both continuously changing quantities and discretely occurring events. The coupling between these measurements may provide insights into key underlying mechanisms of the…

Methodology · Statistics 2020-05-11 Shervin Safavi , Nikos K. Logothetis , Michel Besserve

A major challenge for causal inference from time-series data is the trade-off between computational feasibility and accuracy. Motivated by process motifs for lagged covariance in an autoregressive model with slow mean-reversion, we propose…

Machine Learning · Statistics 2025-09-30 Alice C. Schwarze , Sara M. Ichinaga , Bingni W. Brunton

Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur…

Methodology · Statistics 2022-09-19 Yu Gu , Donglin Zeng , Gerardo Heiss , D. Y. Lin

We investigate the state space reconstruction from multiple time series derived from continuous and discrete systems and propose a method for building embedding vectors progressively using information measure criteria regarding past,…

Chaotic Dynamics · Physics 2015-05-19 Ioannis Vlachos , Dimitris Kugiumtzis

We study mixture of linear regression (random coefficient) models, which capture population heterogeneity by allowing the regression coefficients to follow an unknown distribution $G^*$. In contrast to common parametric methods that fix the…

Methodology · Statistics 2025-07-01 Hansheng Jiang , Adityanand Guntuboyina

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

Understanding dependencies between variables is critical for interpretability and efficient generation in masked diffusion models (MDMs), yet these models primarily expose marginal conditional distributions and do not explicitly represent…

Machine Learning · Computer Science 2026-05-21 Jai Sharma , Yifan Wang , Bryan Li

Data from spectrophotometers form vectors of a large number of exploitable variables. Building quantitative models using these variables most often requires using a smaller set of variables than the initial one. Indeed, a too large number…

Machine Learning · Computer Science 2007-09-26 Fabrice Rossi , Amaury Lendasse , Damien François , Vincent Wertz , Michel Verleysen

In complex dynamical systems, the detection of coupling and its direction from observed time series is a challenging task. We study coupling in coupled Duffing oscillator systems in regular and chaotic dynamical regimes. By observing the…

Adaptation and Self-Organizing Systems · Physics 2021-06-22 Martin Brešar , Pavle Boškoski , Martin Horvat

Estimating mutual information from observed samples is a basic primitive, useful in several machine learning tasks including correlation mining, information bottleneck clustering, learning a Chow-Liu tree, and conditional independence…

Information Theory · Computer Science 2018-10-11 Weihao Gao , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

This paper develops a linear minimum mean-square error (LMMSE) channel estimator for single and multicarrier systems that takes advantage of the mutual coupling in antenna arrays. We model the mutual coupling through multiport networks and…

Information Theory · Computer Science 2023-04-18 Bamelak Tadele , Volodymyr Shyianov , Faouzi Bellili , Amine Mezghani

Multiview embedding is a way to model strange attractors that takes advantage of the way measurements are often made in real chaotic systems, using multidimensional measurements to make up for a lack of long timeseries. Predictive multiview…

Applications · Statistics 2021-06-23 M. LuValle

Multiple antenna (MIMO) devices are widely used to increase reliability and information bit rate. Optimal error rate performance (full diversity and large coding gain), for unknown channel state information at the transmitter and for…

Information Theory · Computer Science 2012-05-14 Dieter Duyck , Sheng Yang , Fambirai Takawira , Joseph J. Boutros , Marc Moeneclaey

Convergent Cross Mapping (CCM) is a powerful method for detecting causality in coupled nonlinear dynamical systems, providing a model-free approach to capture dynamic causal interactions. Partial Cross Mapping (PCM) was introduced as an…

Machine Learning · Computer Science 2025-02-07 Elise Zhang , François Mirallès , Raphaël Rousseau-Rizzi , Arnaud Zinflou , Di Wu , Benoit Boulet

In recent years, word embeddings have been widely used to measure biases in texts. Even if they have proven to be effective in detecting a wide variety of biases, metrics based on word embeddings lack transparency and interpretability. We…

Computation and Language · Computer Science 2023-07-19 Francisco Valentini , Germán Rosati , Damián Blasi , Diego Fernandez Slezak , Edgar Altszyler

Embedding techniques have become essential components of large databases in the deep learning era. By encoding discrete entities, such as words, items, or graph nodes, into continuous vector spaces, embeddings facilitate more efficient…

Information Retrieval · Computer Science 2024-10-18 Shiwei Li , Zhuoqi Hu , Xing Tang , Haozhao Wang , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

The estimation of causal network architectures in the brain is fundamental for understanding cognitive information processes. However, access to the dynamic processes underlying cognition is limited to indirect measurements of the hidden…

Neurons and Cognition · Quantitative Biology 2020-08-17 H. C. Ruiz-Euler , H. J. Kappen

Building upon the Chatterjee correlation (2021: J. Am. Stat. Assoc. 116, p2009) for two real-valued variables, this study introduces a generalized measure of directed association between two vector variables, real or complex-valued, and of…

Methodology · Statistics 2024-06-26 Roberto D. Pascual-Marqui , Kieko Kochi , Toshihiko Kinoshita

The paper investigates the link between Granger causality graphs recently formalized by Eichler and directed information theory developed by Massey and Kramer. We particularly insist on the implication of two notions of causality that may…

Information Theory · Computer Science 2012-03-27 Pierre-Olivier Amblard , Olivier J. J. Michel

Evaluating the causal effect of an intervention on multivariate outcomes is challenging when the outcomes are interdependent and derived rather than directly observed. Effective connectivity, which summarizes the directional neural…

Methodology · Statistics 2026-04-02 Haiyue Song , Ani Eloyan , Youjin Lee