English
Related papers

Related papers: Mitigating Data Redundancy to Revitalize Transform…

200 papers

Sequence-to-sequence models based on LSTM and GRU are a most popular choice for forecasting time series data reaching state-of-the-art performance. Training such models can be delicate though. The two most common training strategies within…

Machine Learning · Computer Science 2022-10-18 Philipp Teutsch , Patrick Mäder

Diffusion models have recently emerged as powerful frameworks for generating high-quality images. While recent studies have explored their application to time series forecasting, these approaches face significant challenges in cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Weilin Ruan , Siru Zhong , Haomin Wen , Yuxuan Liang

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

Machine Learning · Computer Science 2022-02-15 Li Shen , Yangzhu Wang

Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spatial-temporal shifts. This issue is particularly acute in…

Machine Learning · Computer Science 2023-12-04 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of…

Machine Learning · Computer Science 2025-09-22 Qi Xiong , Kai Tang , Minbo Ma , Ji Zhang , Jie Xu , Tianrui Li

Weather forecasting is crucial for public safety, disaster prevention and mitigation, agricultural production, and energy management, with global relevance. Although deep learning has significantly advanced weather prediction, current…

Machine Learning · Computer Science 2025-02-18 Shixuan Li , Wei Yang , Peiyu Zhang , Xiongye Xiao , Defu Cao , Yuehan Qin , Xiaole Zhang , Yue Zhao , Paul Bogdan

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

This study proposes a novel hybrid deep learning framework that integrates a Large Language Model (LLM) with a Transformer architecture for stock price forecasting. The research addresses a critical theoretical gap in existing approaches…

Anomalies in time-series provide insights of critical scenarios across a range of industries, from banking and aerospace to information technology, security, and medicine. However, identifying anomalies in time-series data is particularly…

Machine Learning · Computer Science 2022-08-31 Wadie Skaf , Tomáš Horváth

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

This paper applies a recurrent neural network, the LSTM, to forecast inflation. This is an appealing model for time series as it processes each time step sequentially and explicitly learns dynamic dependencies. The paper also explores the…

Econometrics · Economics 2023-10-03 Livia Paranhos

Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial…

Machine Learning · Computer Science 2023-09-06 Smit Marvaniya , Jitendra Singh , Nicolas Galichet , Fred Ochieng Otieno , Geeth De Mel , Kommy Weldemariam

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on…

Machine Learning · Computer Science 2025-12-23 Zezhi Shao , Fei Wang , Tao Sun , Chengqing Yu , Yuchen Fang , Guangyin Jin , Zhulin An , Yang Liu , Xiaobo Qu , Yongjun Xu

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

Machine Learning · Computer Science 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo

In recent years, transformer-based models have gained prominence in multivariate long-term time series forecasting (LTSF), demonstrating significant advancements despite facing challenges such as high computational demands, difficulty in…

Machine Learning · Computer Science 2024-08-13 Musleh Alharthi , Ausif Mahmood

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

Machine Learning · Computer Science 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

Machine Learning · Computer Science 2025-06-17 Hans Krupakar , Kandappan V A

Code-mixed languages, characterized by frequent within-sentence language transitions, present structural challenges that standard language models fail to address. In this work, we propose CMLFormer, an enhanced multi-layer dual-decoder…

Computation and Language · Computer Science 2025-05-20 Aditeya Baral , Allen George Ajith , Roshan Nayak , Mrityunjay Abhijeet Bhanja

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Jianlei Zhang , Binil Starly

In continual time series analysis using neural networks, catastrophic forgetting (CF) of previously learned models when training on new data domains has always been a significant challenge. This problem is especially challenging in vehicle…

Machine Learning · Computer Science 2025-04-08 Arvin Hosseinzadeh , Ladan Khoshnevisan , Mohammad Pirani , Shojaeddin Chenouri , Amir Khajepour