中文
相关论文

相关论文: Mitigating Data Redundancy to Revitalize Transform…

200 篇论文

Sequence-to-sequence models based on LSTM and GRU are a most popular choice for forecasting time series data reaching state-of-the-art performance. Training such models can be delicate though. The two most common training strategies within…

机器学习 · 计算机科学 2022-10-18 Philipp Teutsch , Patrick Mäder

Diffusion models have recently emerged as powerful frameworks for generating high-quality images. While recent studies have explored their application to time series forecasting, these approaches face significant challenges in cross-modal…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Weilin Ruan , Siru Zhong , Haomin Wen , Yuxuan Liang

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

机器学习 · 计算机科学 2022-02-15 Li Shen , Yangzhu Wang

Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spatial-temporal shifts. This issue is particularly acute in…

机器学习 · 计算机科学 2023-12-04 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of…

机器学习 · 计算机科学 2025-09-22 Qi Xiong , Kai Tang , Minbo Ma , Ji Zhang , Jie Xu , Tianrui Li

Weather forecasting is crucial for public safety, disaster prevention and mitigation, agricultural production, and energy management, with global relevance. Although deep learning has significantly advanced weather prediction, current…

机器学习 · 计算机科学 2025-02-18 Shixuan Li , Wei Yang , Peiyu Zhang , Xiongye Xiao , Defu Cao , Yuehan Qin , Xiaole Zhang , Yue Zhao , Paul Bogdan

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

机器学习 · 计算机科学 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

This study proposes a novel hybrid deep learning framework that integrates a Large Language Model (LLM) with a Transformer architecture for stock price forecasting. The research addresses a critical theoretical gap in existing approaches…

Anomalies in time-series provide insights of critical scenarios across a range of industries, from banking and aerospace to information technology, security, and medicine. However, identifying anomalies in time-series data is particularly…

机器学习 · 计算机科学 2022-08-31 Wadie Skaf , Tomáš Horváth

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

机器学习 · 计算机科学 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

This paper applies a recurrent neural network, the LSTM, to forecast inflation. This is an appealing model for time series as it processes each time step sequentially and explicitly learns dynamic dependencies. The paper also explores the…

计量经济学 · 经济学 2023-10-03 Livia Paranhos

Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial…

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on…

机器学习 · 计算机科学 2025-12-23 Zezhi Shao , Fei Wang , Tao Sun , Chengqing Yu , Yuchen Fang , Guangyin Jin , Zhulin An , Yang Liu , Xiaobo Qu , Yongjun Xu

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

机器学习 · 计算机科学 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo

In recent years, transformer-based models have gained prominence in multivariate long-term time series forecasting (LTSF), demonstrating significant advancements despite facing challenges such as high computational demands, difficulty in…

机器学习 · 计算机科学 2024-08-13 Musleh Alharthi , Ausif Mahmood

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

机器学习 · 计算机科学 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

机器学习 · 计算机科学 2025-06-17 Hans Krupakar , Kandappan V A

Code-mixed languages, characterized by frequent within-sentence language transitions, present structural challenges that standard language models fail to address. In this work, we propose CMLFormer, an enhanced multi-layer dual-decoder…

计算与语言 · 计算机科学 2025-05-20 Aditeya Baral , Allen George Ajith , Roshan Nayak , Mrityunjay Abhijeet Bhanja

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

信号处理 · 电气工程与系统科学 2019-07-30 Jianlei Zhang , Binil Starly

In continual time series analysis using neural networks, catastrophic forgetting (CF) of previously learned models when training on new data domains has always been a significant challenge. This problem is especially challenging in vehicle…

机器学习 · 计算机科学 2025-04-08 Arvin Hosseinzadeh , Ladan Khoshnevisan , Mohammad Pirani , Shojaeddin Chenouri , Amir Khajepour