中文
相关论文

相关论文: Autoformer: Decomposition Transformers with Auto-C…

200 篇论文

Retrosynthesis prediction is one of the fundamental challenges in organic synthesis. The task is to predict the reactants given a core product. With the advancement of machine learning, computer-aided synthesis planning has gained…

化学物理 · 物理学 2022-02-01 Yue Wan , Benben Liao , Chang-Yu Hsieh , Shengyu Zhang

Origin-Destination (OD) matrices record directional flow data between pairs of OD regions. The intricate spatiotemporal dependency in the matrices makes the OD matrix forecasting (ODMF) problem not only intractable but also non-trivial.…

人工智能 · 计算机科学 2022-08-18 Jin Huang , Bosong Huang , Weihao Yu , Jing Xiao , Ruzhong Xie , Ke Ruan

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

机器学习 · 计算机科学 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

机器学习 · 计算机科学 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview…

机器学习 · 计算机科学 2023-07-27 Sabeen Ahmed , Ian E. Nielsen , Aakash Tripathi , Shamoon Siddiqui , Ghulam Rasool , Ravi P. Ramachandran

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

机器学习 · 计算机科学 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

机器学习 · 计算机科学 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

Multivariate time series (MTS) forecasting has been extensively applied across diverse domains, such as weather prediction and energy consumption. However, current studies still rely on the vanilla point-wise self-attention mechanism to…

机器学习 · 计算机科学 2024-05-21 Yingnan Yang , Qingling Zhu , Jianyong Chen

Time series forecasting plays a critical role in domains such as energy, finance, and healthcare, where accurate predictions inform decision-making under uncertainty. Although Transformer-based models have demonstrated success in sequential…

机器学习 · 计算机科学 2025-05-27 Ali Forootani , Mohammad Khosravi

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

机器学习 · 计算机科学 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

Time series forecasting is an important challenge with significant applications in areas such as weather prediction, stock market analysis, scientific simulations and industrial process analysis. In this work, we introduce LMS-AutoTSF, a…

机器学习 · 计算机科学 2025-01-08 Ibrahim Delibasoglu , Sanjay Chakraborty , Fredrik Heintz

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

机器学习 · 计算机科学 2022-05-11 Ning Wang

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

机器学习 · 计算机科学 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

机器学习 · 计算机科学 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

Traffic prediction is a flourishing research field due to its importance in human mobility in the urban space. Despite this, existing studies only focus on short-term prediction of up to few hours in advance, with most being up to one hour…

机器学习 · 计算机科学 2023-03-06 David Alexander Tedjopurnomo , Farhana M. Choudhury , A. K. Qin

The increasing severity of climate change necessitates an urgent transition to renewable energy sources, making the large-scale adoption of wind energy crucial for mitigating environmental impact. However, the inherent uncertainty of wind…

机器学习 · 计算机科学 2024-10-18 Chongyang Wan , Shunbo Lei , Yuan Luo

Time series forecasting requires architectures that simultaneously achieve three competing objectives: (1) strict temporal causality for reliable predictions, (2) sub-quadratic complexity for practical scalability, and (3) multi-scale…

机器学习 · 计算机科学 2025-11-25 Qianru Zhang , Honggang Wen , Ming Li , Dong Huang , Siu-Ming Yiu , Christian S. Jensen , Pietro Liò

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

机器学习 · 计算机科学 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

机器学习 · 计算机科学 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo