English
Related papers

Related papers: FredNormer: Frequency Domain Normalization for Non…

200 papers

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

Machine Learning · Computer Science 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

Spectral analysis provides one of the most effective paradigms for information-preserving dimensionality reduction, as simple descriptions of naturally occurring signals are often obtained via few terms of periodic basis functions. In this…

Machine Learning · Computer Science 2022-11-29 Michael Poli , Stefano Massaroli , Federico Berto , Jinykoo Park , Tri Dao , Christopher Ré , Stefano Ermon

Financial markets are inherently volatile and prone to sudden disruptions such as market crashes, flash collapses, and liquidity crises. Accurate anomaly detection and early risk forecasting in financial time series are therefore crucial…

Machine Learning · Computer Science 2025-11-18 Ziling Fan , Ruijia Liang , Yiwen Hu

Convolutional neural networks have demonstrated impressive results in many computer vision tasks. However, the increasing size of these networks raises concerns about the information overload resulting from the large number of network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenqiu Zhao , Guanfang Dong , Shupei Zhang , Zijie Tan , Anup Basu

Convolutional neural network (CNN) has achieved impressive success in computer vision during the past few decades. The image convolution operation helps CNNs to get good performance on image-related tasks. However, it also has high…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hengyue Pan , Yixin Chen , Zhiliang Tian , Peng Qiao , Linbo Qiao , Dongsheng Li

While accuracy is a critical requirement for time series forecasting, an equally important desideratum is forecast stability across forecast creation dates (FCDs). Even highly accurate models can produce erratic revisions between FCDs,…

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

Machine Learning · Computer Science 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

Time series forecasting models are becoming increasingly prevalent due to their critical role in decision-making across various domains. However, most existing approaches represent the coupled temporal patterns, often neglecting the…

Machine Learning · Computer Science 2025-09-26 Jintao Zhang , Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Daoyu Wang

While recent advancements in foundation models have significantly impacted machine learning, rigorous tests on the performance of time series foundation models (TSFMs) remain largely underexplored. This paper presents an empirical study…

Machine Learning · Computer Science 2025-01-09 Syamantak Datta Gupta

Recent generalizable fault diagnosis researches have effectively tackled the distributional shift between unseen working conditions. Most of them mainly focus on learning domain-invariant representation through feature-level methods.…

Machine Learning · Computer Science 2025-02-04 Xiaotong Tu , Chenyu Ma , Qingyao Wu , Yinhao Liu , Hongyang Zhang

Domain generalization (DG) is a principal task to evaluate the robustness of computer vision models. Many previous studies have used normalization for DG. In normalization, statistics and normalized features are regarded as style and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sangrok Lee , Jongseong Bae , Ha Young Kim

Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, \ie…

Machine Learning · Computer Science 2025-10-21 Mingyuan Xia , Chunxu Zhang , Zijian Zhang , Hao Miao , Qidong Liu , Yuanshao Zhu , Bo Yang

Normalization has become one of the most fundamental components in many deep neural networks for machine learning tasks while deep neural network has also been widely used in CTR estimation field. Among most of the proposed deep neural…

Machine Learning · Computer Science 2020-07-08 Zhiqiang Wang , Qingyun She , PengTao Zhang , Junlin Zhang

We introduce a model-agnostic forward diffusion process for time-series forecasting that decomposes signals into spectral components, preserving structured temporal patterns such as seasonality more effectively than standard diffusion.…

Machine Learning · Statistics 2026-02-17 Francisco Caldas , Sahil Kumar , Cláudia Soares

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

Machine Learning · Computer Science 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Learning the underlying dynamics from data with deep neural networks has shown remarkable potential in modeling various complex physical dynamics. However, current approaches are constrained in their ability to make reliable predictions in…

Machine Learning · Computer Science 2025-07-02 Tiexin Qin , Hong Yan , Haoliang Li

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequency-domain…

Machine Learning · Computer Science 2026-04-14 Shunyu Wu , Jiawei Huang , Weibin Feng , Boxin Li , Xiao Zhang , Erli Meng , Dan Li , Jian Lou , See-Kiong Ng

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Complex distribution shifts are the main obstacle to achieving accurate long-term time series forecasting. Several efforts have been conducted to capture the distribution characteristics and propose adaptive normalization techniques to…

Machine Learning · Computer Science 2024-10-01 Dalin Qin , Yehui Li , Weiqi Chen , Zhaoyang Zhu , Qingsong Wen , Liang Sun , Pierre Pinson , Yi Wang

Workload forecasting is pivotal in cloud service applications, such as auto-scaling and scheduling, with profound implications for operational efficiency. Although Transformer-based forecasting models have demonstrated remarkable success in…

Machine Learning · Computer Science 2025-07-18 Jiadong Chen , Hengyu Ye , Fuxin Jiang , Xiao He , Tieying Zhang , Jianjun Chen , Xiaofeng Gao