中文
相关论文

相关论文: Beyond All-to-All: Causal-Aligned Transformer with…

200 篇论文

We present a representation learning framework for financial time series forecasting. One challenge of using deep learning models for finance forecasting is the shortage of available training data when using small datasets. Direct trend…

机器学习 · 计算机科学 2021-05-10 Hanwei Wu , Ather Gattami , Markus Flierl

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

Transformers have demonstrated remarkable efficacy in forecasting time series data. However, their extensive dependence on self-attention mechanisms demands significant computational resources, thereby limiting their practical applicability…

机器学习 · 计算机科学 2024-06-26 Cat P. Le , Chris Cannella , Ali Hasan , Yuting Ng , Vahid Tarokh

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

机器学习 · 计算机科学 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

机器学习 · 计算机科学 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong

In multivariable time series (MTS) forecasting, existing state-of-the-art deep learning approaches tend to focus on autoregressive formulations and often overlook the potential of using exogenous variables in enhancing the prediction of the…

机器学习 · 计算机科学 2025-04-03 Yuxuan Shu , Vasileios Lampos

We present a very general approach to learning the structure of causal models based on d-separation constraints, obtained from any given set of overlapping passive observational or experimental data sets. The procedure allows for both…

人工智能 · 计算机科学 2013-09-27 Antti Hyttinen , Patrik O. Hoyer , Frederick Eberhardt , Matti Jarvisalo

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

机器学习 · 统计学 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

In unsupervised causal representation learning for sequential data with time-delayed latent causal influences, strong identifiability results for the disentanglement of causally-related latent variables have been established in stationary…

机器学习 · 计算机科学 2024-08-02 Xiangchen Song , Weiran Yao , Yewen Fan , Xinshuai Dong , Guangyi Chen , Juan Carlos Niebles , Eric Xing , Kun Zhang

We explore the usage of meta-learning to derive the causal direction between variables by optimizing over a measure of distribution simplicity. We incorporate a stochastic graph representation which includes latent variables and allows for…

机器学习 · 计算机科学 2021-06-11 Justin Wong , Dominik Damjakob

We investigate the problem of inferring the causal predictors of a response $Y$ from a set of $d$ explanatory variables $(X^1,\dots,X^d)$. Classical ordinary least squares regression includes all predictors that reduce the variance of $Y$.…

统计理论 · 数学 2018-05-29 Niklas Pfister , Peter Bühlmann , Jonas Peters

Utilizing the complex inter-variable causal relationships within multivariate time-series provides a promising avenue toward more robust and reliable multivariate time-series anomaly detection (MTSAD) but remains an underexplored area of…

机器学习 · 计算机科学 2025-06-05 HyunGi Kim , Jisoo Mok , Dongjun Lee , Jaihyun Lew , Sungjae Kim , Sungroh Yoon

Spatial-temporal causal time series (STC-TS) involve region-specific temporal observations driven by causally relevant covariates and interconnected across geographic or network-based spaces. Existing methods often model spatial and…

机器学习 · 计算机科学 2025-11-13 Yang Yang , Du Yin , Hao Xue , Flora Salim

Recent research demonstrates that linear models achieve forecasting performance competitive with complex architectures, yet methodologies for enhancing linear models remain underexplored. Motivated by the hypothesis that distinct time…

机器学习 · 计算机科学 2025-10-13 Zipo Jibao , Yingyi Fu , Xinyang Chen , Guoting Chen

Time-series forecasting increasingly demands not only accurate observational predictions but also causal forecasting under interventional and counterfactual queries in multivariate systems. We present DoFlow, a flow-based generative model…

机器学习 · 统计学 2026-03-03 Dongze Wu , Feng Qiu , Yao Xie

Time-to-Collision (TTC) forecasting is a critical task in collision prevention, requiring precise temporal prediction and comprehending both local and global patterns encapsulated in a video, both spatially and temporally. To address the…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Nishq Poorav Desai , Ali Etemad , Michael Greenspan

Time series generation (TSG) synthesizes realistic sequences and has achieved remarkable success. Among TSG, conditional models generate sequences given observed covariates, however, such models learn observational correlations without…

机器学习 · 计算机科学 2026-05-15 Yutong Xia , Chang Xu , Yuxuan Liang , Li Zhao , Qingsong Wen , Roger Zimmermann , Jiang Bian

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

机器学习 · 计算机科学 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

机器学习 · 计算机科学 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

机器学习 · 统计学 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters