English
Related papers

Related papers: Transforming Causality: Transformer-Based Temporal…

200 papers

In many fields$\unicode{x2013}$including genomics, epidemiology, natural language processing, social and behavioral sciences, and economics$\unicode{x2013}$it is increasingly important to address causal questions in the context of factor…

Methodology · Statistics 2025-06-30 Jenna M. Landy , Dafne Zorzetto , Roberta De Vito , Giovanni Parmigiani

Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining.…

Understanding causal relations between temporal variables is a central challenge in time series analysis, particularly when the full causal structure is unknown. Even when the full causal structure cannot be fully specified, experts often…

Artificial Intelligence · Computer Science 2026-03-16 Timothée Loranchet , Charles K. Assaad

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Causal inference from observational data following the restricted structural causal models (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or…

Machine Learning · Computer Science 2024-05-30 Kang Du , Yu Xiang

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

We present a novel approach to constraint-based causal discovery, that takes the form of straightforward logical inference, applied to a list of simple, logical statements about causal relations that are derived directly from observed…

Artificial Intelligence · Computer Science 2012-02-20 Tom Claassen , Tom Heskes

In this paper we present a comprehensive view of prominent causal discovery algorithms, categorized into two main categories (1) assuming acyclic and no latent variables, and (2) allowing both cycles and latent variables, along with…

Artificial Intelligence · Computer Science 2017-09-13 Karamjit Singh , Garima Gupta , Vartika Tewari , Gautam Shroff

Human intention prediction is a growing area of research where an activity in a video has to be anticipated by a vision-based system. To this end, the model creates a representation of the past, and subsequently, it produces future…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nada Osman , Guglielmo Camporese , Lamberto Ballan

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

Machine Learning · Computer Science 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Most approaches for assessing causality in complex dynamical systems fail when the interactions between variables are inherently non-linear and non-stationary. Here we introduce Temporal Autoencoders for Causal Inference (TACI), a…

Machine Learning · Computer Science 2024-06-06 Josuan Calderon , Gordon J. Berman

Causality plays a central role in understanding interactions between variables in complex systems. These systems often exhibit state-dependent causal relationships, where both the strength and direction of causality vary with the value of…

Data Analysis, Statistics and Probability · Physics 2025-08-05 Álvaro Martínez-Sánchez , Adrián Lozano-Durán

One critical challenge of time-series modeling is how to learn and quickly correct the model under unknown distribution shifts. In this work, we propose a principled framework, called LiLY, to first recover time-delayed latent causal…

Machine Learning · Statistics 2022-02-25 Weiran Yao , Guangyi Chen , Kun Zhang

Causal modeling provides us with powerful counterfactual reasoning and interventional mechanism to generate predictions and reason under various what-if scenarios. However, causal discovery using observation data remains a nontrivial task…

Machine Learning · Computer Science 2023-01-06 Jawad Chowdhury , Rezaur Rashid , Gabriel Terejanu

Recently in the field of unsupervised representation learning, strong identifiability results for disentanglement of causally-related latent variables have been established by exploiting certain side information, such as class labels, in…

Machine Learning · Computer Science 2022-10-26 Weiran Yao , Guangyi Chen , Kun Zhang

Causality is a non-obvious concept that is often considered to be related to temporality. In this paper we present a number of past and present approaches to the definition of temporality and causality from philosophical, physical, and…

Machine Learning · Computer Science 2010-07-16 Kamran Karimi

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation. Recent advances establish identifiability…

Machine Learning · Computer Science 2024-12-25 Ryan Welch , Jiaqi Zhang , Caroline Uhler

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

Machine Learning · Computer Science 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Time series domain adaptation aims to transfer the complex temporal dependence from the labeled source domain to the unlabeled target domain. Recent advances leverage the stable causal mechanism over observed variables to model the…

Machine Learning · Computer Science 2025-02-25 Ruichu Cai , Junxian Huang , Zhenhui Yang , Zijian Li , Emadeldeen Eldele , Min Wu , Fuchun Sun