中文
相关论文

相关论文: Scaleformer: Iterative Multi-scale Refining Transf…

200 篇论文

Rapid expansion of model size has emerged as a key challenge in time series forecasting. From early Transformer with tens of megabytes to recent architectures like TimesNet with thousands of megabytes, performance gains have often come at…

机器学习 · 计算机科学 2025-05-16 Zeyan Li , Libing Chen , Yin Tang

This paper investigates the application of Transformer-based neural networks to stock price forecasting, with a special focus on the intersection of machine learning techniques and financial market analysis. The evolution of Transformer…

计算工程、金融与科学 · 计算机科学 2024-12-31 Kamil Ł. Szydłowski , Jarosław A. Chudziak

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

机器学习 · 计算机科学 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

Time series forecasting plays a critical role in domains such as energy, finance, and healthcare, where accurate predictions inform decision-making under uncertainty. Although Transformer-based models have demonstrated success in sequential…

机器学习 · 计算机科学 2025-05-27 Ali Forootani , Mohammad Khosravi

In this paper, we present a new approach to time series forecasting. Time series data are prevalent in many scientific and engineering disciplines. Time series forecasting is a crucial task in modeling time series data, and is an important…

机器学习 · 计算机科学 2020-01-24 Neo Wu , Bradley Green , Xue Ben , Shawn O'Banion

Transformers have recently gained prominence in long time series forecasting by elevating accuracies in a variety of use cases. Regrettably, in the race for better predictive performance the overhead of model architectures has grown…

Time series forecasting is an important problem, with many real world applications. Ensembles of deep neural networks have recently achieved impressive forecasting accuracy, but such large ensembles are impractical in many real world…

机器学习 · 计算机科学 2022-08-31 Espen Haugsdal , Erlend Aune , Massimiliano Ruocco

In the domain of multivariate forecasting, transformer models stand out as powerful apparatus, displaying exceptional capabilities in handling messy datasets from real-world contexts. However, the inherent complexity of these datasets,…

机器学习 · 计算机科学 2024-03-08 Jingjing Xu , Caesar Wu , Yuan-Fang Li , Pascal Bouvry

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

机器学习 · 计算机科学 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

The Transformer model has shown strong performance in multivariate time series forecasting by leveraging channel-wise self-attention. However, this approach lacks temporal constraints when computing temporal features and does not utilize…

机器学习 · 计算机科学 2025-05-06 Shiwei Guo , Ziang Chen , Yupeng Ma , Yunfei Han , Yi Wang

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

机器学习 · 计算机科学 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Currently, iTransformer is one of the most popular and effective models for multivariate time series (MTS) forecasting. Thanks to its inverted framework, iTransformer effectively captures multivariate correlation. However, the inverted…

机器学习 · 计算机科学 2025-07-17 Hongming Tan , Ting Chen , Ruochong Jin , Wai Kin Chan

Temporal set prediction involves forecasting the elements that will appear in the next set, given a sequence of prior sets, each containing a variable number of elements. Existing methods often rely on intricate architectures with…

机器学习 · 计算机科学 2025-04-25 Ashish Ranjan , Ayush Agarwal , Shalin Barot , Sushant Kumar

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate variations and…

机器学习 · 计算机科学 2024-10-08 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Li Zhang , Jianmin Wang , Mingsheng Long

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

机器学习 · 计算机科学 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

The Transformer model has shown leading performance in time series forecasting. Nevertheless, in some complex scenarios, it tends to learn low-frequency features in the data and overlook high-frequency features, showing a frequency bias.…

机器学习 · 计算机科学 2024-07-04 Xihao Piao , Zheng Chen , Taichi Murayama , Yasuko Matsubara , Yasushi Sakurai

In this paper, we find that ubiquitous time series (TS) forecasting models are prone to severe overfitting. To cope with this problem, we embrace a de-redundancy approach to progressively reinstate the intrinsic values of TS for future…

机器学习 · 计算机科学 2024-06-18 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Bingzheng Zhang , Minggao Zhang

Patch-wise Transformer based time series forecasting achieves superior accuracy. However, this superiority relies heavily on intricate model design with massive parameters, rendering both training and inference expensive, thus preventing…

机器学习 · 计算机科学 2025-01-22 Meng Wang , Jintao Yang , Bin Yang , Hui Li , Tongxin Gong , Bo Yang , Jiangtao Cui

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

人工智能 · 计算机科学 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu