English
Related papers

Related papers: A feature-based information-theoretic approach for…

200 papers

Discovering causal relationships from time series data is significant in fields such as finance, climate science, and neuroscience. However, contemporary techniques rely on the simplifying assumption that data originates from the same…

Machine Learning · Computer Science 2024-06-25 Sumanth Varambally , Yi-An Ma , Rose Yu

Functional data often arise from measurements on fine time grids and are obtained by separating an almost continuous time record into natural consecutive intervals, for example, days. The functions thus obtained form a functional time…

Statistics Theory · Mathematics 2016-08-14 Siegfried Hörmann , Piotr Kokoszka

In complex systems, events occur at irregular intervals that inherently encode the underlying dynamics of the system. Analyzing the temporal clustering of these events reveals critical insights into the non-random patterns and the temporal…

Data Analysis, Statistics and Probability · Physics 2026-03-20 Ambedkar Sanket Sukdeo , K. Shri Vignesh , Sachin S. Gunthe , T Narayan Rao , Amit Kumar Patra , R. I. Sujith

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the…

Machine Learning · Computer Science 2019-07-02 Rohit Bhattacharya , Daniel Malinsky , Ilya Shpitser

Capturing the dynamical properties of time series concisely as interpretable feature vectors can enable efficient clustering and classification for time-series applications across science and industry. Selecting an appropriate feature-based…

Information Retrieval · Computer Science 2019-02-05 Carl H Lubba , Sarab S Sethi , Philip Knaute , Simon R Schultz , Ben D Fulcher , Nick S Jones

Several data-driven approaches based on information theory have been proposed for analyzing high-order interactions involving three or more components of a network system. Most of these methods are defined only in the time domain and rely…

Applications · Statistics 2025-03-18 Yuri Antonacci , Chiara Bara' , Laura Sparacino , Gorana Mijatovic , Ludovico Minati , Luca Faes

The principles of statistical mechanics and information theory play an important role in learning and have inspired both theory and the design of numerous machine learning algorithms. The new aspect in this paper is a focus on integrating…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Susanne Still

Data is essential to performing time series analysis utilizing machine learning approaches, whether for classic models or today's large language models. A good time-series dataset is advantageous for the model's accuracy, robustness, and…

Machine Learning · Computer Science 2024-04-29 Chenxi Sun , Hongyan Li , Yaliang Li , Shenda Hong

We propose a method for filling gaps and removing interferences in time series for applications involving continuous monitoring of environmental variables. The approach is non-parametric and based on an iterative pattern-matching between…

Geophysics · Physics 2015-08-11 Gregoire Mariethoz , Niklas Linde , Damien Jougnot , Hassan Rezaee

This paper introduces a new framework for recovering causal graphs from observational data, leveraging the observation that the distribution of an effect, conditioned on its causes, remains invariant to changes in the prior distribution of…

Machine Learning · Computer Science 2026-02-04 Nang Hung Nguyen , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang , Masashi Sugiyama

Understanding how features interact with each other is of paramount importance in many scientific discoveries and contemporary applications. Yet interaction identification becomes challenging even for a moderate number of covariates. In…

Methodology · Statistics 2016-05-31 Yingying Fan , Yinfei Kong , Daoji Li , Jinchi Lv

Relationships among time series can be exploited as inductive biases in learning effective forecasting models. In hierarchical time series, relationships among subsets of sequences induce hard constraints (hierarchical inductive biases) on…

Machine Learning · Computer Science 2024-08-22 Andrea Cini , Danilo Mandic , Cesare Alippi

Multivariate time series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the…

Methodology · Statistics 2023-11-03 Zhaolu Liu , Robert L. Peach , Felix Laumann , Sara Vallejo Mengod , Mauricio Barahona

Changes in the timescales at which complex systems evolve are essential to predicting critical transitions and catastrophic failures. Disentangling the timescales of the dynamics governing complex systems remains a key challenge. With this…

Methodology · Statistics 2024-03-11 Giona Casiraghi , Georges Andres

Causal inference seeks to identify cause-and-effect interactions in coupled systems. A recently proposed method by Liang detects causal relations by quantifying the direction and magnitude of information flow between time series. The…

Data Analysis, Statistics and Probability · Physics 2024-03-20 Dionissios T. Hristopulos

Two numerical methods are proposed for detection of coupling between multiple time series generated by deterministic nonlinear systems. The first detects interdependence or the existence of coupling between time series. The second…

Chaotic Dynamics · Physics 2025-05-07 Timothy Sauer , George Sugihara

Learning features from data is one of the defining characteristics of deep learning, but our theoretical understanding of the role features play in deep learning is still rudimentary. To address this gap, we introduce a new tool, the…

Machine Learning · Computer Science 2023-06-09 Yiding Jiang , Christina Baek , J. Zico Kolter

Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data.…

Change points in real-world systems mark significant regime shifts in system dynamics, possibly triggered by exogenous or endogenous factors. These points define regimes for the time evolution of the system and are crucial for understanding…

Machine Learning · Statistics 2025-09-30 Ioanna-Yvonni Tsaknaki , Fabrizio Lillo , Piero Mazzarisi