English
Related papers

Related papers: Frequency-Constrained Learning for Long-Term Forec…

200 papers

Time series forecasting is essential in a wide range of real world applications. Recently, frequency-domain methods have attracted increasing interest for their ability to capture global dependencies. However, when applied to non-stationary…

Machine Learning · Statistics 2026-02-09 Zhongde An , Jinhong You , Jiyanglin Li , Yiming Tang , Wen Li , Heming Du , Shouguo Du

While numerous forecasters have been proposed using different network architectures, the Transformer-based models have state-of-the-art performance in time series forecasting. However, forecasters based on Transformers are still suffering…

Machine Learning · Computer Science 2024-11-06 Kun Yi , Jingru Fei , Qi Zhang , Hui He , Shufeng Hao , Defu Lian , Wei Fan

Recent advancements have progressively incorporated frequency-based techniques into deep learning models, leading to notable improvements in accuracy and efficiency for time series analysis tasks. However, the Mid-Frequency Spectrum Gap in…

Machine Learning · Computer Science 2025-03-04 Guoqi Yu , Yaoming Li , Juncheng Wang , Xiaoyu Guo , Angelica I. Aviles-Rivero , Tong Yang , Shujun Wang

We introduce a model-agnostic forward diffusion process for time-series forecasting that decomposes signals into spectral components, preserving structured temporal patterns such as seasonality more effectively than standard diffusion.…

Machine Learning · Statistics 2026-02-17 Francisco Caldas , Sahil Kumar , Cláudia Soares

The ability to forecast far into the future is highly beneficial to many applications, including but not limited to climatology, energy consumption, and logistics. However, due to noise or measurement error, it is questionable how far into…

Machine Learning · Computer Science 2022-05-26 Fan-Keng Sun , Duane S. Boning

Fourier-encoded implicit neural representations (INRs) have shown strong capability in modeling continuous signals from discrete samples. However, conventional Fourier feature mappings use a fixed set of frequencies over the entire spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ligen Shi , Jun Qiu , Yuhang Zheng , Zengyu Pang , Chang Liu

Standard direct forecasting models typically rely on point-wise objectives such as Mean Squared Error, which fail to capture the complex spatio-temporal dependencies inherent in graph-structured signals. While recent frequency-domain…

Machine Learning · Computer Science 2026-03-06 Zepu Wang , Bowen Liao , Jeff , Ban

Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. However, despite their considerable advantages over traditional…

Machine Learning · Computer Science 2024-07-02 Ruiqi Li , Maowei Jiang , Kai Wang , Kaiduo Feng , Quangao Liu , Yue Sun , Xiufang Zhou

This paper presents \textbf{FreEformer}, a simple yet effective model that leverages a \textbf{Fre}quency \textbf{E}nhanced Trans\textbf{former} for multivariate time series forecasting. Our work is based on the assumption that the…

Machine Learning · Computer Science 2025-01-27 Wenzhen Yue , Yong Liu , Xianghua Ying , Bowei Xing , Ruohao Guo , Ji Shi

Transformer has shown promise in reinforcement learning to model time-varying features for obtaining generalized low-level robot policies on diverse robotics datasets in embodied learning. However, it still suffers from the issues of low…

Machine Learning · Computer Science 2024-12-19 Hengkai Tan , Songming Liu , Kai Ma , Chengyang Ying , Xingxing Zhang , Hang Su , Jun Zhu

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Multivariate time-series (MTS) forecasting is fundamental to applications ranging from urban mobility and resource management to climate modeling. While recent generative models based on denoising diffusion have advanced state-of-the-art…

Machine Learning · Computer Science 2025-11-21 Seyed Mohamad Moghadas , Bruno Cornelis , Adrian Munteanu

Time series anomaly detection is critical for system monitoring and risk identification, across various domains, such as finance and healthcare. However, for most reconstruction-based approaches, detecting anomalies remains a challenge due…

Machine Learning · Computer Science 2025-05-13 Wenxin Zhang , Ding Xu , Guangzhen Yao , Xiaojian Lin , Renxiang Guan , Chengze Du , Renda Han , Xi Xuan , Cuicui Luo

Cross-frequency transfer learning (CFTL) has emerged as a popular framework for curating large-scale time series datasets to pre-train foundation forecasting models (FFMs). Although CFTL has shown promise, current benchmarking practices…

Fourier methods have a long and proven track record as an excellent tool in data processing. As memory and computational constraints gain importance in embedded and mobile applications, we propose to combine Fourier methods and recurrent…

Machine Learning · Computer Science 2020-08-17 Moritz Wolter , Juergen Gall , Angela Yao

In this paper we propose a scalable version of a state-of-the-art deterministic time-invariant feature extraction approach based on consecutive changes of basis and nonlinearities, namely, the scattering network. The first focus of the…

Machine Learning · Statistics 2017-07-20 Randall Balestriero , Herve Glotin

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

Machine Learning · Computer Science 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

Understanding the effect of depth in deep learning is a critical problem. In this work, we utilize the Fourier analysis to empirically provide a promising mechanism to understand why feedforward deeper learning is faster. To this end, we…

Machine Learning · Computer Science 2020-12-22 Zhi-Qin John Xu , Hanxu Zhou

In deep time series forecasting, the Fourier Transform (FT) is extensively employed for frequency representation learning. However, it often struggles in capturing multi-scale, time-sensitive patterns. Although the Wavelet Transform (WT)…

Machine Learning · Computer Science 2026-02-09 Ziyu Zhou , Jiaxi Hu , Qingsong Wen , James T. Kwok , Yuxuan Liang