English
Related papers

Related papers: Fourier-domain transfer entropy spectrum

200 papers

This paper proposes a flexible new framework for constructing Neyman-orthogonal scores in semiparametric models involving infinite-dimensional nuisance parameters. While locally estimation is vital for integrating machine learning into…

Methodology · Statistics 2026-04-30 Kun Ren , Wen Su , Li Liu , Ian W. McKeague , Xingqiu Zhao

Recently discovered measurement-induced entanglement phase transitions in monitored quantum circuits provide a novel example of far-from-equilibrium quantum criticality. Here, we propose a highly efficient strategy for experimentally…

Quantum Physics · Physics 2023-07-24 Ali G. Moghaddam , Kim Pöyhönen , Teemu Ojanen

In modeling multivariate time series for either forecast or policy analysis, it would be beneficial to have figured out the cause-effect relations within the data. Regression analysis, however, is generally for correlation relation, and…

Machine Learning · Statistics 2021-11-23 Xingwei Hu

Entropy can signify different things: For instance, heat transfer in thermodynamics or a measure of information in data analysis. Many entropies have been introduced and it can be difficult to ascertain their different importance and…

Mathematical Physics · Physics 2025-07-10 Henrik Jeldtoft Jensen , Piergiulio Tempesta

We derive fundamental sampling bounds for smooth signals in continuous settings without sparsity assumptions. By introducing the Fourier ratio as a measure of spectral compressibility induced by smoothness, we obtain explicit, deterministic…

Classical Analysis and ODEs · Mathematics 2026-01-27 A. Iosevich , E. Palsson , A. Yavicoli

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer…

Quantitative Methods · Quantitative Biology 2021-02-17 Sebastiano Stramaglia , Tomas Scagliarini , Yuri Antonacci , Luca Faes

This study addresses the problem of learning an extended summary causal graph on time series. The algorithms we propose fit within the well-known constraint-based framework for causal discovery and make use of information-theoretic measures…

Artificial Intelligence · Computer Science 2022-05-20 Charles K. Assaad , Emilie Devijver , Eric Gaussier

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

Although nonstationary data are more common in the real world, most existing causal discovery methods do not take nonstationarity into consideration. In this letter, we propose a kernel embedding-based approach, ENCI, for nonstationary…

Machine Learning · Statistics 2018-09-25 Shoubo Hu , Zhitang Chen , Laiwan Chan

The notion of metric entropy dimension is introduced to measure the complexity of entropy zero dynamical systems. For measure preserving systems, we define entropy dimension via the dimension of entropy generating sequences. This…

Dynamical Systems · Mathematics 2018-02-27 Dou Dou , Wen Huang , Kyewon Koh Park

Spreading phenomena on networks are essential for the collective dynamics of various natural and technological systems, from information spreading in gene regulatory networks to neural circuits or from epidemics to supply networks…

Physics and Society · Physics 2021-06-01 Justine Wolter , Benedict Lünsmann , Xiaozhu Zhang , Malte Schröder , Marc Timme

In classical information theory, a causal relationship between two variables is typically modelled by assuming that, for every possible state of one of the variables, there exists a particular distribution of states of the second variable.…

Information Theory · Computer Science 2023-02-28 Joel R. Peck , David Waxman

The ability to distinguish between correlation and causation of variables in molecular systems remains an interesting and open area of investigation. In this work, we probe causality in a molecular system using two independent computational…

Chemical Physics · Physics 2025-02-27 Vittorio Del Tatto , Debarshi Banerjee , Ali Hassanali , Alessandro Laio

We consider discrete stochastic processes, modeled by classical master equations, on networks. The temporal growth of the lack of information about the system is captured by its non-equilibrium entropy, defined via the transition…

Statistical Mechanics · Physics 2017-04-26 Oliver Muelken , Sarah Heinzelmann , Maxim Dolgushev

Multivariate time series imputation is fundamental in applications such as healthcare, traffic forecasting, and biological modeling, where sensor failures and irregular sampling lead to pervasive missing values. However, existing…

Machine Learning · Computer Science 2025-12-18 Runze Li , Hanchen Wang , Wenjie Zhang , Binghao Li , Yu Zhang , Xuemin Lin , Ying Zhang

For control systems in discrete time, this paper discusses measure-theoretic invariance entropy for a subset Q of the state space with respect to a quasi-stationary measure obtained by endowing the control range with a probability measure.…

Dynamical Systems · Mathematics 2018-04-05 Fritz Colonius

Finding the source of a disturbance or fault in complex systems such as industrial chemical processing plants can be a difficult task and consume a significant number of engineering hours. In many cases, a systematic elimination procedure…

Information Theory · Computer Science 2019-04-09 Simon Streicher , Carl Sandrock

We consider the problem of extrapolating treatment effects across heterogeneous populations (``sites"/``contexts"). We consider an idealized scenario in which the researcher observes cross-sectional data for a large number of units across…

Econometrics · Economics 2025-10-03 Konrad Menzel