中文
相关论文

相关论文: SCFormer: Structured Channel-wise Transformer with…

200 篇论文

Modeling continuous-time dynamics on irregular time series is critical to account for data evolution and correlations that occur continuously. Traditional methods including recurrent neural networks or Transformer models leverage inductive…

机器学习 · 计算机科学 2024-02-19 Yuqi Chen , Kan Ren , Yansen Wang , Yuchen Fang , Weiwei Sun , Dongsheng Li

Traffic prediction remains a key challenge in spatio-temporal data mining, despite progress in deep learning. Accurate forecasting is hindered by the complex influence of external factors such as traffic accidents and regulations, often…

机器学习 · 计算机科学 2025-12-11 Hongjun Wang , Jiawei Yong , Jiawei Wang , Shintaro Fukushima , Renhe Jiang

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global…

机器学习 · 计算机科学 2026-01-29 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

机器学习 · 计算机科学 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

机器学习 · 计算机科学 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

机器学习 · 计算机科学 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

机器学习 · 计算机科学 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

机器学习 · 计算机科学 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

机器学习 · 计算机科学 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

机器学习 · 计算机科学 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

Multivariate time series classification is a crucial task in data mining, attracting growing research interest due to its broad applications. While many existing methods focus on discovering discriminative patterns in time series,…

机器学习 · 计算机科学 2024-12-24 Wenjie Xi , Rundong Zuo , Alejandro Alvarez , Jie Zhang , Byron Choi , Jessica Lin

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Spatiotemporal data is ubiquitous, and forecasting it has important applications in many domains. However, its complex cross-component dependencies and non-linear temporal dynamics can be challenging for traditional techniques. Existing…

机器学习 · 计算机科学 2025-03-27 Hao Yuan Bai , Xue Liu

The quadratic complexity of standard self-attention severely limits the application of Transformer-based models to long-context tasks. While efficient Transformer variants exist, they often require architectural changes and costly…

计算与语言 · 计算机科学 2025-11-14 Jiangshu Du , Wenpeng Yin , Philip Yu

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

机器学习 · 计算机科学 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

机器学习 · 计算机科学 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Time series forecasting at scale presents significant challenges for modern prediction systems, particularly when dealing with large sets of synchronized series, such as in a global payment network. In such systems, three key challenges…

Video snapshot compressive imaging (SCI) captures multiple sequential video frames by a single measurement using the idea of computational imaging. The underlying principle is to modulate high-speed frames through different masks and these…

图像与视频处理 · 电气工程与系统科学 2022-09-09 Lishun Wang , Miao Cao , Yong Zhong , Xin Yuan

Time series forecasting is a crucial challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. This paper introduces an embedded decomposed transformer, 'EDformer', for…

机器学习 · 计算机科学 2024-12-18 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

机器学习 · 计算机科学 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz