English
Related papers

Related papers: Transforming Causality: Transformer-Based Temporal…

200 papers

Causal discovery from time series is critical for many real-world applications, such as tracing the root causes of anomalies. Existing approaches typically rely on dataset-specific optimization, making it difficult to transfer their causal…

Machine Learning · Computer Science 2026-05-27 Biao Ouyang , Tengxue Zhang , Zhihao Zhuang , Yang Shu , Chenjuan Guo , Bin Yang

Causal discovery from time series is a fundamental task in machine learning. However, its widespread adoption is hindered by a reliance on untestable causal assumptions and by the lack of robustness-oriented evaluation in existing…

Machine Learning · Computer Science 2026-05-01 Huiyang Yi , Xiaojian Shen , Yonggang Wu , Duxin Chen , He Wang , Wenwu Yu

Causal discovery from time-series data aims to capture both intra-slice (contemporaneous) and inter-slice (time-lagged) causality between variables within the temporal chain, which is crucial for various scientific disciplines. Compared to…

Machine Learning · Computer Science 2026-01-26 Rujia Shen , Boran Wang , Chao Zhao , Yi Guan , Jingchi Jiang

Granger causality, commonly used for inferring causal structures from time series data, has been adopted in widespread applications across various fields due to its intuitive explainability and high compatibility with emerging deep neural…

Machine Learning · Computer Science 2024-06-18 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Temporal data, representing chronological observations of complex systems, has always been a typical data structure that can be widely generated by many domains, such as industry, medicine and finance. Analyzing this type of data is…

Machine Learning · Computer Science 2023-08-04 Chang Gong , Di Yao , Chuzhe Zhang , Wenbin Li , Jingping Bi

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from…

Machine Learning · Computer Science 2022-09-15 Hang Chen , Keqing Du , Xinyu Yang , Chenguang Li

Causal discovery aims to learn causal relationships between variables from targeted data, making it a fundamental task in machine learning. However, causal discovery algorithms often rely on unverifiable causal assumptions, which are…

Machine Learning · Computer Science 2025-10-15 Huiyang Yi , Yanyan He , Duxin Chen , Mingyu Kang , He Wang , Wenwu Yu

Causal sensitivity analysis aims to provide bounds for causal effect estimates in the presence of unobserved confounding. However, existing methods for causal sensitivity analysis are per-instance procedures, meaning that changes to the…

Machine Learning · Statistics 2026-05-12 Emil Javurek , Dennis Frauen , Marie Brockschmidt , Jonas Schweisthal , Stefan Feuerriegel

Our goal is to estimate causal interactions in multivariate time series. Using vector autoregressive (VAR) models, these can be defined based on non-vanishing coefficients belonging to respective time-lagged instances. As in most cases a…

Methodology · Statistics 2010-08-13 Stefan Haufe , Guido Nolte , Klaus-Robert Mueller , Nicole Kraemer

Nonlinear machine-learning models are increasingly used to discover causal relationships in time-series data, yet the interpretation of their outputs remains poorly understood. In particular, causal scores produced by regularized neural…

Machine Learning · Computer Science 2026-05-27 Valentina Kuskova , Dmitry Zaytsev , Michael Coppedge

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

Machine Learning · Computer Science 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

This paper proposes two methods for causal additive models with unobserved variables (CAM-UV). CAM-UV assumes that the causal functions take the form of generalized additive models and that latent confounders are present. First, we propose…

Machine Learning · Computer Science 2024-01-19 Takashi Nicholas Maeda , Shohei Shimizu

This work extends causal inference with stochastic confounders. We propose a new approach to variational estimation for causal inference based on a representer theorem with a random input space. We estimate causal effects involving latent…

Machine Learning · Statistics 2021-01-26 Thanh Vinh Vo , Pengfei Wei , Wicher Bergsma , Tze-Yun Leong

Identifying the underlying time-delayed latent causal processes in sequential data is vital for grasping temporal dynamics and making downstream reasoning. While some recent methods can robustly identify these latent causal variables, they…

Machine Learning · Computer Science 2024-05-31 Guangyi Chen , Yifan Shen , Zhenhao Chen , Xiangchen Song , Yuewen Sun , Weiran Yao , Xiao Liu , Kun Zhang

We propose a counterfactual approach to train ``causality-aware" predictive models that are able to leverage causal information in static anticausal machine learning tasks (i.e., prediction tasks where the outcome influences the features).…

Applications · Statistics 2020-12-01 Elias Chaibub Neto

Transformers have exhibited exceptional capabilities in sequence modeling tasks, leveraging self-attention and in-context learning. Critical to this success are induction heads, attention circuits that enable copying tokens based on their…

Machine Learning · Computer Science 2025-09-11 Francesco D'Angelo , Francesco Croce , Nicolas Flammarion

Temporal causal representation learning is a powerful tool for uncovering complex patterns in observational studies, which are often represented as low-dimensional time series. However, in many real-world applications, data are…

Machine Learning · Computer Science 2025-07-21 Jianhong Chen , Meng Zhao , Mostafa Reisi Gahrooei , Xubo Yue

Causal inference, a critical tool for informing business decisions, traditionally relies heavily on structured data. However, in many real-world scenarios, such data can be incomplete or unavailable. This paper presents a framework that…

Machine Learning · Computer Science 2026-02-17 Boning Zhou , Ziyu Wang , Han Hong , Haoqi Hu

Time series analysis is a vital task with broad applications in various domains. However, effectively capturing cross-dimension and cross-time dependencies in non-stationary time series poses significant challenges, particularly in the…

Machine Learning · Computer Science 2024-03-14 Kexuan Zhang , Xiaobei Zou , Yang Tang

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar