中文
相关论文

相关论文: Sensorformer: Cross-patch attention with global-pa…

200 篇论文

We introduce a novel framework for temporal causal discovery and inference that addresses two key challenges: complex nonlinear dependencies and spurious correlations. Our approach employs a multi-layer Transformer-based time-series…

机器学习 · 计算机科学 2025-08-25 Jihua Huang , Yi Yao , Ajay Divakaran

Time series forecasting methods generally fall into two main categories: Channel Independent (CI) and Channel Dependent (CD) strategies. While CI overlooks important covariate relationships, CD captures all dependencies without distinction,…

机器学习 · 计算机科学 2025-05-21 Yifan Hu , Guibin Zhang , Peiyuan Liu , Disen Lan , Naiqi Li , Dawei Cheng , Tao Dai , Shu-Tao Xia , Shirui Pan

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

机器学习 · 计算机科学 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

机器学习 · 计算机科学 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

The Transformer model has shown strong performance in multivariate time series forecasting by leveraging channel-wise self-attention. However, this approach lacks temporal constraints when computing temporal features and does not utilize…

机器学习 · 计算机科学 2025-05-06 Shiwei Guo , Ziang Chen , Yupeng Ma , Yunfei Han , Yi Wang

Time-series data are critical in diverse applications, such as industrial monitoring, medical diagnostics, and climate research. However, effectively integrating these high-dimensional temporal signals with natural language for dynamic,…

计算与语言 · 计算机科学 2025-06-26 Yilin Wang , Peixuan Lei , Jie Song , Yuzhe Hao , Tao Chen , Yuxuan Zhang , Lei Jia , Yuanxiang Li , Zhongyu Wei

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

机器学习 · 计算机科学 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

Downsampling-based methods for time series forecasting have attracted increasing attention due to their superiority in capturing sequence trends. However, this approaches mainly capture dependencies within subsequences but neglect…

计算工程、金融与科学 · 计算机科学 2026-01-21 Zhangyao Song , Nanqing Jiang , Miaohong He , Xiaoyu Zhao , Tao Guo

Real-world multichannel time series prediction faces growing demands for efficiency across edge and cloud environments, making channel compression a timely and essential problem. Motivated by the success of Multiple-Input Multiple-Output…

机器学习 · 计算机科学 2026-01-30 Ziqi Liu , Pei Zeng , Yi Ding

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

机器学习 · 计算机科学 2026-01-29 Wei Li

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

机器学习 · 统计学 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

机器学习 · 计算机科学 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Time series analysis is a vital task with broad applications in various domains. However, effectively capturing cross-dimension and cross-time dependencies in non-stationary time series poses significant challenges, particularly in the…

机器学习 · 计算机科学 2024-03-14 Kexuan Zhang , Xiaobei Zou , Yang Tang

Transformers have shown great power in time series forecasting due to their global-range modeling ability. However, their performance can degenerate terribly on non-stationary real-world data in which the joint distribution changes over…

机器学习 · 计算机科学 2023-11-27 Yong Liu , Haixu Wu , Jianmin Wang , Mingsheng Long

Time series forecasting has played a significant role in many practical fields. But time series data generated from real-world applications always exhibits high variance and lots of noise, which makes it difficult to capture the inherent…

机器学习 · 计算机科学 2024-10-10 Yangyang Guo , Yanjun Zhao , Sizhe Dang , Tian Zhou , Liang Sun , Yi Qian

Origin-Destination (OD) matrices record directional flow data between pairs of OD regions. The intricate spatiotemporal dependency in the matrices makes the OD matrix forecasting (ODMF) problem not only intractable but also non-trivial.…

人工智能 · 计算机科学 2022-08-18 Jin Huang , Bosong Huang , Weihao Yu , Jing Xiao , Ruzhong Xie , Ke Ruan

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Temporal Graph Neural Networks have garnered substantial attention for their capacity to model evolving structural and temporal patterns while exhibiting impressive performance. However, it is known that these architectures are encumbered…

机器学习 · 计算机科学 2024-02-12 Mahdi Biparva , Raika Karimi , Faezeh Faez , Yingxue Zhang

Time series data, including univariate and multivariate ones, are characterized by unique composition and complex multi-scale temporal variations. They often require special consideration of decomposition and multi-scale modeling to…

机器学习 · 计算机科学 2024-03-26 Shuhan Zhong , Sizhe Song , Weipeng Zhuo , Guanyao Li , Yang Liu , S. -H. Gary Chan

Transformers have demonstrated remarkable efficacy in forecasting time series data. However, their extensive dependence on self-attention mechanisms demands significant computational resources, thereby limiting their practical applicability…

机器学习 · 计算机科学 2024-06-26 Cat P. Le , Chris Cannella , Ali Hasan , Yuting Ng , Vahid Tarokh