English
Related papers

Related papers: Transforming Causality: Transformer-Based Temporal…

200 papers

On time-series data, most causal discovery methods fit a new model whenever they encounter samples from a new underlying causal graph. However, these samples often share relevant information which is lost when following this approach.…

Machine Learning · Computer Science 2022-02-24 Sindy Löwe , David Madras , Richard Zemel , Max Welling

Causality defines the relationship between cause and effect. In multivariate time series field, this notion allows to characterize the links between several time series considering temporal lags. These phenomena are particularly important…

Methodology · Statistics 2023-06-01 Antonin Arsac , Aurore Lomet , Jean-Philippe Poli

Causal discovery, i.e., inferring underlying causal relationships from observational data, is highly challenging for AI systems. In a time series modeling context, traditional causal discovery methods mainly consider constrained scenarios…

In this study, we present a novel constraint-based algorithm for causal structure learning specifically designed for nonlinear autoregressive time series. Our algorithm significantly reduces computational complexity compared to existing…

Machine Learning · Computer Science 2025-07-11 Mohammad Fesanghary , Achintya Gopal

We introduce a novel framework to financial time series forecasting that leverages causality-inspired models to balance the trade-off between invariance to distributional changes and minimization of prediction errors. To the best of our…

Computational Finance · Quantitative Finance 2024-08-20 Daniel Cunha Oliveira , Yutong Lu , Xi Lin , Mihai Cucuringu , Andre Fujita

Multivariate time series in domains such as finance, climate science, and healthcare often exhibit long-term trends, seasonal patterns, and short-term fluctuations, complicating causal inference under non-stationarity and autocorrelation.…

Machine Learning · Computer Science 2026-04-29 Muhammad Hasan Ferdous , Md Osman Gani

Granger causality is widely used for causal structure discovery in complex systems from multivariate time series data. Traditional Granger causality tests based on linear models often fail to detect even mild non-linear causal…

Machine Learning · Computer Science 2025-10-23 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Transformer-based models have become state-of-the-art tools in various machine learning tasks, including time series classification, yet their complexity makes understanding their internal decision-making challenging. Existing…

Machine Learning · Computer Science 2025-11-27 Matīss Kalnāre , Sofoklis Kitharidis , Thomas Bäck , Niki van Stein

This paper studies causal discovery in irregularly sampled time series-a key challenge in risk-sensitive domains like finance, healthcare, and climate science, where missing data and inconsistent sampling frequencies distort causal…

Machine Learning · Computer Science 2026-05-12 Weihong Li , Baohong Li , Anpeng Wu , Zhihan Li , Ming Ma , Keting Yin , Kun Kuang

This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a…

Machine Learning · Computer Science 2025-10-21 Ziyu Lu , Anika Tabassum , Shruti Kulkarni , Lu Mi , J. Nathan Kutz , Eric Shea-Brown , Seung-Hwan Lim

Causal discovery from time series data encompasses many existing solutions, including those based on deep learning techniques. However, these methods typically do not endorse one of the most prevalent paradigms in deep learning: End-to-end…

Machine Learning · Computer Science 2024-02-15 Gideon Stein , Maha Shadaydeh , Joachim Denzler

Causal discovery is the subfield of causal inference concerned with estimating the structure of cause-and-effect relationships in a system of interrelated variables, as opposed to quantifying the strength or describing the form of causal…

Methodology · Statistics 2026-03-26 Rebecca F. Supple , Hannah Worthington , Ben Swallow

Transformer-based methods have shown great potential in long-term time series forecasting. However, most of these methods adopt the standard point-wise self-attention mechanism, which not only becomes intractable for long-term forecasting…

Machine Learning · Computer Science 2022-02-24 Dazhao Du , Bing Su , Zhewei Wei

Causal discovery algorithms aim at untangling complex causal relationships from data. Here, we study causal discovery and inference methods based on staged tree models, which can represent complex and asymmetric causal relationships between…

Methodology · Statistics 2023-03-02 Manuele Leonelli , Gherardo Varando

Understanding directed temporal interactions in multivariate time series is essential for interpreting complex dynamical systems and the predictive models trained on them. We present Causal-INSIGHT, a model-agnostic, post-hoc interpretation…

Machine Learning · Computer Science 2026-03-27 Benjamin Redden , Hui Wang , Shuyan Li

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this…

Machine Learning · Computer Science 2026-02-16 Xingyu Zhang , Hanyun Du , Zeen Song , Siyu Zhao , Changwen Zheng , Wenwen Qiang

Recent work has shown promising results in causal discovery by leveraging interventional data with gradient-based methods, even when the intervened variables are unknown. However, previous work assumes that the correspondence between…

Machine Learning · Computer Science 2022-07-12 Gonçalo R. A. Faria , André F. T. Martins , Mário A. T. Figueiredo

Identifying causal relationships from observational time series data is a key problem in disciplines such as climate science or neuroscience, where experiments are often not possible. Data-driven causal inference is challenging since…

Methodology · Statistics 2019-12-03 Jakob Runge , Peer Nowack , Marlene Kretschmer , Seth Flaxman , Dino Sejdinovic

Counterfactual learning has become promising for understanding and modeling causality in complex and dynamic systems. This paper presents a novel method for counterfactual learning in the context of multivariate time series analysis and…

Machine Learning · Computer Science 2026-03-03 Gianlucca Zuin , Adriano Veloso