English
Related papers

Related papers: Transforming Causality: Transformer-Based Temporal…

200 papers

Many real-world decision-making tasks require learning causal relationships between a set of variables. Traditional causal discovery methods, however, require that all variables are observed, which is often not feasible in practical…

Methodology · Statistics 2023-06-27 Raj Agrawal , Chandler Squires , Neha Prasad , Caroline Uhler

Methods of causal discovery aim to identify causal structures in a data driven way. Existing algorithms are known to be unstable and sensitive to statistical errors, and are therefore rarely used with biomedical or epidemiological data. We…

Methodology · Statistics 2024-07-01 Christine W Bang , Janine Witte , Ronja Foraita , Vanessa Didelez

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris

A widely applied approach to causal inference from a non-experimental time series $X$, often referred to as "(linear) Granger causal analysis", is to regress present on past and interpret the regression matrix $\hat{B}$ causally. However,…

Machine Learning · Statistics 2015-12-23 Philipp Geiger , Kun Zhang , Mingming Gong , Dominik Janzing , Bernhard Schölkopf

This article presents a novel method for causal discovery with generalized structural equation models suited for analyzing diverse types of outcomes, including discrete, continuous, and mixed data. Causal discovery often faces challenges…

Methodology · Statistics 2023-10-26 Minjie Wang , Xiaotong Shen , Wei Pan

Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an…

Methodology · Statistics 2026-03-27 Alex Chen , Qing Zhou

This paper focuses on the problem of semi-supervised domain adaptation for time-series forecasting, which is underexplored in literatures, despite being often encountered in practice. Existing methods on time-series domain adaptation mainly…

Machine Learning · Computer Science 2023-09-07 Zijian Li , Ruichu Cai , Tom Z. J Fu , Zhifeng Hao , Kun Zhang

Causal interactions in time series networks can be dynamic and nonlinear, making it difficult to identify them using conventional linear causality estimations. We propose a novel approach, called Threshold Autoregressive Modeling for…

Applications · Statistics 2025-09-19 Sipan Aslan , Hernando Ombao

Time series data is a collection of chronological observations which is generated by several domains such as medical and financial fields. Over the years, different tasks such as classification, forecasting, and clustering have been…

Machine Learning · Computer Science 2021-02-12 Raha Moraffah , Paras Sheth , Mansooreh Karami , Anchit Bhattacharya , Qianru Wang , Anique Tahir , Adrienne Raglin , Huan Liu

Our goal is to recover time-delayed latent causal variables and identify their relations from measured temporal data. Estimating causally-related latent variables from observations is particularly challenging as the latent variables are not…

Machine Learning · Statistics 2022-02-10 Weiran Yao , Yuewen Sun , Alex Ho , Changyin Sun , Kun Zhang

The aim of this paper is to discuss a recent result which shows that probabilistic inference in the presence of (unknown) causal mechanisms can be tractable for models that have traditionally been viewed as intractable. This result was…

Artificial Intelligence · Computer Science 2022-02-08 Adnan Darwiche

Going beyond correlations, the understanding and identification of causal relationships in observational time series, an important subfield of Causal Discovery, poses a major challenge. The lack of access to a well-defined ground truth for…

Machine Learning · Statistics 2021-04-19 Andrew R. Lawrence , Marcus Kaiser , Rui Sampaio , Maksim Sipos

Causal structure discovery in complex dynamical systems is an important challenge for many scientific domains. Although data from (interventional) experiments is usually limited, large amounts of observational time series data sets are…

Machine Learning · Computer Science 2021-10-19 Bart Bussmann , Jannes Nys , Steven Latré

Causal discovery from observational data is a challenging task that can only be solved up to a set of equivalent solutions, called an equivalence class. Such classes, which are often large in size, encode uncertainties about the orientation…

Machine Learning · Computer Science 2022-03-01 Philippe Brouillard , Perouz Taslakian , Alexandre Lacoste , Sebastien Lachapelle , Alexandre Drouin

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Data-driven societal event forecasting methods exploit relevant historical information to predict future events. These methods rely on historical labeled data and cannot accurately predict events when data are limited or of poor quality.…

Machine Learning · Computer Science 2021-12-13 Songgaojun Deng , Huzefa Rangwala , Yue Ning

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in…

Machine Learning · Statistics 2017-10-31 Dustin Tran , David M. Blei

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

Machine Learning · Computer Science 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang