中文
相关论文

相关论文: Scaleformer: Iterative Multi-scale Refining Transf…

200 篇论文

Time series forecasting plays a crucial role in decision-making across various domains, but it presents significant challenges. Recent studies have explored image-driven approaches using computer vision models to address these challenges,…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Tucker Balch , Manuela Veloso

The current landscape in time-series forecasting is dominated by Transformer-based models. Their high parameter count and corresponding demand in computational resources pose a challenge to real-world deployment, especially for commercial…

机器学习 · 计算机科学 2024-12-18 Nicholas Kiefer , Arvid Weyrauch , Muhammed Öz , Achim Streit , Markus Götz , Charlotte Debus

As industrial recommender systems enter a scaling-driven regime, Transformer architectures have become increasingly attractive for scaling models towards larger capacity and longer sequence. However, existing Transformer-based…

信息检索 · 计算机科学 2026-02-17 Xu Huang , Hao Zhang , Zhifang Fan , Yunwen Huang , Zhuoxing Wei , Zheng Chai , Jinan Ni , Yuchao Zheng , Qiwei Chen

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

机器学习 · 计算机科学 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

Time-series forecasting plays an important role in many real-world scenarios, such as equipment life cycle forecasting, weather forecasting, and traffic flow forecasting. It can be observed from recent research that a variety of…

机器学习 · 计算机科学 2022-06-14 Benhan Li , Shengdong Du , Tianrui Li , Jie Hu , Zhen Jia

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

机器学习 · 计算机科学 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

To the naked eye, stock prices are considered chaotic, dynamic, and unpredictable. Indeed, it is one of the most difficult forecasting tasks that hundreds of millions of retail traders and professional traders around the world try to do…

计算金融 · 定量金融 2025-02-17 Shuozhe Li , Zachery B Schulwol , Risto Miikkulainen

Time series forecasting has long been dominated by advances in model architecture, with recent progress driven by deep learning and hybrid statistical techniques. However, as forecasting models approach diminishing returns in accuracy, a…

机器学习 · 计算机科学 2026-01-29 Daojun Liang , Qi Li , Yinglong Wang , Jing Chen , Hu Zhang , Xiaoxiao Cui , Qizheng Wang , Shuo Li

Sequentially obtained dataset usually exhibits different behavior at different data resolutions/scales. Instead of inferring from data at each scale individually, it is often more informative to interpret the data as an ensemble of time…

介观与纳米尺度物理 · 物理学 2021-03-19 Yuan Yang , Jie Ding

Sequential user modeling, a critical task in personalized recommender systems, focuses on predicting the next item a user would prefer, requiring a deep understanding of user behavior sequences. Despite the remarkable success of…

人工智能 · 计算机科学 2023-10-10 Hao Wang , Jianxun Lian , Mingqi Wu , Haoxuan Li , Jiajun Fan , Wanyue Xu , Chaozhuo Li , Xing Xie

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

机器学习 · 计算机科学 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

In the domain of multivariate time series analysis, the concept of channel independence has been increasingly adopted, demonstrating excellent performance due to its ability to eliminate noise and the influence of irrelevant variables.…

机器学习 · 计算机科学 2024-12-18 Haoxin Wang , Yipeng Mo , Kunlan Xiang , Nan Yin , Honghe Dai , Bixiong Li , Songhai Fan , Site Mo

Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous…

机器学习 · 计算机科学 2023-02-07 Mike Van Ness , Huibin Shen , Hao Wang , Xiaoyong Jin , Danielle C. Maddix , Karthick Gopalswamy

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

机器学习 · 计算机科学 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

机器学习 · 计算机科学 2022-05-11 Ning Wang

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

机器学习 · 计算机科学 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

机器学习 · 计算机科学 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

This paper introduces WeatherFormer, a transformer encoder-based model designed to learn robust weather features from minimal observations. It addresses the challenge of modeling complex weather dynamics from small datasets, a bottleneck…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Adib Hasan , Mardavij Roozbehani , Munther Dahleh

Forecasting models that are trained across sets of many time series, known as Global Forecasting Models (GFM), have shown recently promising results in forecasting competitions and real-world applications, outperforming many…

机器学习 · 计算机科学 2020-08-07 Kasun Bandara , Hansika Hewamalage , Yuan-Hao Liu , Yanfei Kang , Christoph Bergmeir

Large pre-trained models have demonstrated remarkable capabilities across domains, but their effectiveness in time series forecasting remains understudied. This work empirically examines whether pre-trained large-scale time series models…

机器学习 · 计算机科学 2025-07-08 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz