English
Related papers

Related papers: Transforming Causality: Transformer-Based Temporal…

200 papers

Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal processes do not have instantaneous relations. Although some…

Machine Learning · Computer Science 2026-01-21 Zijian Li , Yifan Shen , Kaitao Zheng , Ruichu Cai , Xiangchen Song , Mingming Gong , Guangyi Chen , Kun Zhang

Latent confounding has been a long-standing obstacle for causal reasoning from observational data. One popular approach is to model the data using acyclic directed mixed graphs (ADMGs), which describe ancestral relations between variables…

Machine Learning · Computer Science 2023-03-23 Matthew Ashman , Chao Ma , Agrin Hilmkil , Joel Jennings , Cheng Zhang

The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture…

Machine Learning · Computer Science 2025-04-11 Yuanyun Zhang , Shi Li

Discovering causal relationships from time series data is significant in fields such as finance, climate science, and neuroscience. However, contemporary techniques rely on the simplifying assumption that data originates from the same…

Machine Learning · Computer Science 2024-06-25 Sumanth Varambally , Yi-An Ma , Rose Yu

In longitudinal studies where units are embedded in space or a social network, interference may arise, meaning that a unit's outcome can depend on treatment histories of others. The presence of interference poses significant challenges for…

Methodology · Statistics 2025-08-26 Ye Wang , Michael Jetsupphasuk

Spatiotemporal time series are usually collected via monitoring sensors placed at different locations, which usually contain missing values due to various failures, such as mechanical damages and Internet outages. Imputing the missing…

Machine Learning · Computer Science 2024-10-24 Baoyu Jing , Dawei Zhou , Kan Ren , Carl Yang

For decades, researchers in fields, such as the natural and social sciences, have been verifying causal relationships and investigating hypotheses that are now well-established or understood as truth. These causal mechanisms are properties…

Machine Learning · Computer Science 2019-12-02 Trent Kyono , Mihaela van der Schaar

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

A typical problem in causal modeling is the instability of model structure learning, i.e., small changes in finite data can result in completely different optimal models. The present work introduces a novel causal modeling algorithm for…

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

Causal inference from observational data following the restricted structural causal model (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or nonlinearity.…

Methodology · Statistics 2021-09-06 Kang Du , Yu Xiang

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict…

Machine Learning · Computer Science 2023-11-30 Bernard Koch , Tim Sainburg , Pablo Geraldo , Song Jiang , Yizhou Sun , Jacob Gates Foster

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

Computational analysis of time-course data with an underlying causal structure is needed in a variety of domains, including neural spike trains, stock price movements, and gene expression levels. However, it can be challenging to determine…

Artificial Intelligence · Computer Science 2012-05-14 Samantha Kleinberg , Bud Mishra

We introduce CausaLab, a scalable environment for evaluating interactive causal discovery by LLM agents. Unlike prior evaluations, CausaLab evaluates both whether an agent can solve a problem using causal evidence and whether its answer is…

Artificial Intelligence · Computer Science 2026-05-29 Junlin Yang , Dylan Zhang , Xiangchen Song , Qirun Dai , Xiao Liu , Yuen Chen , Aniket Vashishtha , Jing Shi , Chenhao Tan , Hao Peng

Recent developments in causal inference allow us to transport a causal effect of a time-fixed treatment from a randomized trial to a target population across space but within the same time frame. In contrast to transportability across…

Methodology · Statistics 2026-03-11 Laura Forastiere , Fan Li , Michela Baccini

We are not only observers but also actors of reality. Our capability to intervene and alter the course of some events in the space and time surrounding us is an essential component of how we build our model of the world. In this doctoral…

Artificial Intelligence · Computer Science 2023-09-19 Gilles Blondel

Interventional causal discovery seeks to identify causal relations by leveraging distributional changes introduced by interventions, even in the presence of latent confounders. Beyond the spurious dependencies induced by latent confounders,…

Machine Learning · Computer Science 2026-02-26 Gongxu Luo , Loka Li , Guangyi Chen , Haoyue Dai , Kun Zhang

Causal inference uses observations to infer the causal structure of the data generating system. We study a class of functional models that we call Time Series Models with Independent Noise (TiMINo). These models require independent residual…

Machine Learning · Statistics 2016-08-18 Jonas Peters , Dominik Janzing , Bernhard Schölkopf