中文
相关论文

相关论文: DRFormer: Multi-Scale Transformer Utilizing Divers…

200 篇论文

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

机器学习 · 计算机科学 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

机器学习 · 计算机科学 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

Accurate forecasting of passenger flows is critical for maintaining the efficiency and resilience of airport operations. Recent advances in patch-based Transformer models have shown strong potential in various time series forecasting tasks.…

机器学习 · 计算机科学 2025-12-16 Wenbo Du , Lingling Han , Ying Xiong , Ling Zhang , Biyue Li , Yisheng Lv , Tong Guo

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

机器学习 · 计算机科学 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

机器学习 · 计算机科学 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

机器学习 · 计算机科学 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

机器学习 · 计算机科学 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Long-term time-series forecasting (LTSF) is fundamental to various real-world applications, where Transformer-based models have become the dominant framework due to their ability to capture long-range dependencies. However, these models…

机器学习 · 计算机科学 2025-03-27 Mingjie Li , Rui Liu , Guangsi Shi , Mingfei Han , Changling Li , Lina Yao , Xiaojun Chang , Ling Chen

In the context of increasing demands for long-term multi-energy load forecasting in real-world applications, this paper introduces Patchformer, a novel model that integrates patch embedding with encoder-decoder Transformer-based…

机器学习 · 计算机科学 2024-04-17 Qiuyi Hong , Fanlin Meng , Felipe Maldonado

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

机器学习 · 计算机科学 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

机器学习 · 计算机科学 2024-12-30 Peiwang Tang , Weitai Zhang

Long-term time series forecasting (LTSF) offers broad utility in practical settings like energy consumption and weather prediction. Accurately predicting long-term changes, however, is demanding due to the intricate temporal patterns and…

机器学习 · 计算机科学 2025-05-19 Boshi Gao , Qingjian Ni , Fanbo Ju , Yu Chen , Ziqi Zhao

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

机器学习 · 统计学 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

机器学习 · 计算机科学 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

机器学习 · 计算机科学 2021-08-19 Radostin Cholakov , Todor Kolev

Time-series forecasting plays an important role in many real-world scenarios, such as equipment life cycle forecasting, weather forecasting, and traffic flow forecasting. It can be observed from recent research that a variety of…

机器学习 · 计算机科学 2022-06-14 Benhan Li , Shengdong Du , Tianrui Li , Jie Hu , Zhen Jia

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What…

机器学习 · 计算机科学 2025-07-18 Lefei Shen , Mouxiang Chen , Han Fu , Xiaoxue Ren , Xiaoyun Joy Wang , Jianling Sun , Zhuo Li , Chenghao Liu

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

计算与语言 · 计算机科学 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

机器学习 · 计算机科学 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci