中文
相关论文

相关论文: PFformer: A Position-Free Transformer Variant for …

200 篇论文

Time series data is a prevalent form of data found in various fields. It consists of a series of measurements taken over time. Forecasting is a crucial application of time series models, where future values are predicted based on historical…

机器学习 · 计算机科学 2025-09-23 Sahar Koohfar , Wubeshet Woldemariam

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

机器学习 · 计算机科学 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Financial prediction is a complex and challenging task of time series analysis and signal processing, expected to model both short-term fluctuations and long-term temporal dependencies. Transformers have remarkable success mostly in natural…

机器学习 · 计算机科学 2025-11-17 Nguyen Kim Hai Bui , Nguyen Duy Chien , Péter Kovács , Gergő Bognár

Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of the sequence. In this paper, we first investigate various…

计算与语言 · 计算机科学 2023-11-09 Jianlin Su , Yu Lu , Shengfeng Pan , Ahmed Murtadha , Bo Wen , Yunfeng Liu

The exponential growth of multivariate time series data from sensor networks in domains like industrial monitoring and smart cities requires efficient and accurate forecasting models. Current deep learning methods often fail to adequately…

机器学习 · 计算机科学 2024-11-08 Xinxing Zhou , Jiaqi Ye , Shubao Zhao , Ming Jin , Chengyi Yang , Yanlong Wen , Xiaojie Yuan

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

机器学习 · 计算机科学 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Recent advances in neural forecasting have produced major improvements in accuracy for probabilistic demand prediction. In this work, we propose novel improvements to the current state of the art by incorporating changes inspired by recent…

机器学习 · 计算机科学 2022-01-28 Carson Eisenach , Yagna Patel , Dhruv Madeka

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

机器学习 · 计算机科学 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines…

机器学习 · 计算机科学 2024-05-24 Noam Koren , Kira Radinsky

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

计算与语言 · 计算机科学 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Due to the non-stationary nature, the distribution of real-world multivariate time series (MTS) changes over time, which is known as distribution drift. Most existing MTS forecasting models greatly suffer from distribution drift and degrade…

机器学习 · 计算机科学 2024-04-03 Hui He , Qi Zhang , Kun Yi , Kaize Shi , Zhendong Niu , Longbing Cao

The intricate nature of time series data analysis benefits greatly from the distinct advantages offered by time and frequency domain representations. While the time domain is superior in representing local dependencies, particularly in…

机器学习 · 计算机科学 2024-04-09 Hengyu Ye , Jiadong Chen , Shijin Gong , Fuxin Jiang , Tieying Zhang , Jianjun Chen , Xiaofeng Gao

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

机器学习 · 计算机科学 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

机器学习 · 计算机科学 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

In deep time series forecasting, the Fourier Transform (FT) is extensively employed for frequency representation learning. However, it often struggles in capturing multi-scale, time-sensitive patterns. Although the Wavelet Transform (WT)…

机器学习 · 计算机科学 2026-02-09 Ziyu Zhou , Jiaxi Hu , Qingsong Wen , James T. Kwok , Yuxuan Liang

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

机器学习 · 计算机科学 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

机器学习 · 计算机科学 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

As Transformer-based models have achieved impressive performance on various time series tasks, Long-Term Series Forecasting (LTSF) tasks have also received extensive attention in recent years. However, due to the inherent computational…

机器学习 · 计算机科学 2024-02-06 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Xiaoyan Ma , Dongyang Li , Minggao Zhang

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context…

机器学习 · 计算机科学 2026-02-04 Huu Hiep Nguyen , Minh Hoang Nguyen , Dung Nguyen , Hung Le

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

机器学习 · 计算机科学 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long