中文
相关论文

相关论文: Frequency-domain MLPs are More Effective Learners …

200 篇论文

Spectral analysis provides one of the most effective paradigms for information-preserving dimensionality reduction, as simple descriptions of naturally occurring signals are often obtained via few terms of periodic basis functions. In this…

机器学习 · 计算机科学 2022-11-29 Michael Poli , Stefano Massaroli , Federico Berto , Jinykoo Park , Tri Dao , Christopher Ré , Stefano Ermon

While Time Series Foundation Models (TSFMs) have demonstrated exceptional performance in generalized forecasting, their performance often degrades significantly when deployed in real-world vertical domains characterized by temporal…

机器学习 · 计算机科学 2026-02-17 Xiaoyun Yu , Li fan , Xiangfei Qiu , Nanqing Dong , Yonggui Huang , Honggang Qi , Geguang Pu , Wanli Ouyang , Xi Chen , Jilin Hu

We show that passing input points through a simple Fourier feature mapping enables a multilayer perceptron (MLP) to learn high-frequency functions in low-dimensional problem domains. These results shed light on recent advances in computer…

Time series forecasting is crucial in many fields, yet current deep learning models struggle with noise, data sparsity, and capturing complex multi-scale patterns. This paper presents MFF-FTNet, a novel framework addressing these challenges…

机器学习 · 计算机科学 2024-11-27 Yangyang Shi , Qianqian Ren , Yong Liu , Jianguo Sun

In this study, we present aLLM4TS, an innovative framework that adapts Large Language Models (LLMs) for time-series representation learning. Central to our approach is that we reconceive time-series forecasting as a self-supervised,…

机器学习 · 计算机科学 2024-03-12 Yuxuan Bian , Xuan Ju , Jiangtong Li , Zhijian Xu , Dawei Cheng , Qiang Xu

Traffic prediction is a typical spatio-temporal data mining task and has great significance to the public transportation system. Considering the demand for its grand application, we recognize key factors for an ideal spatio-temporal…

机器学习 · 计算机科学 2023-09-26 Zijian Zhang , Ze Huang , Zhiwei Hu , Xiangyu Zhao , Wanyu Wang , Zitao Liu , Junbo Zhang , S. Joe Qin , Hongwei Zhao

Time series forecasting has received wide interest from existing research due to its broad applications and inherent challenging. The research challenge lies in identifying effective patterns in historical series and applying them to future…

机器学习 · 计算机科学 2023-07-14 Tianlong Zhao , Xiang Ma , Xuemei Li , Caiming Zhang

The ability to forecast far into the future is highly beneficial to many applications, including but not limited to climatology, energy consumption, and logistics. However, due to noise or measurement error, it is questionable how far into…

机器学习 · 计算机科学 2022-05-26 Fan-Keng Sun , Duane S. Boning

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

机器学习 · 计算机科学 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

As function approximators, deep neural networks have served as an effective tool to represent various signal types. Recent approaches utilize multi-layer perceptrons (MLPs) to learn a nonlinear mapping from a coordinate to its corresponding…

机器学习 · 计算机科学 2025-06-12 Woojin Cho , Minju Jo , Kookjin Lee , Noseong Park

The intricate nature of time series data analysis benefits greatly from the distinct advantages offered by time and frequency domain representations. While the time domain is superior in representing local dependencies, particularly in…

机器学习 · 计算机科学 2024-04-09 Hengyu Ye , Jiadong Chen , Shijin Gong , Fuxin Jiang , Tieying Zhang , Jianjun Chen , Xiaofeng Gao

The modern power grid is facing increasing complexities, primarily stemming from the integration of renewable energy sources and evolving consumption patterns. This paper introduces an innovative methodology that harnesses Convolutional…

机器学习 · 计算机科学 2023-10-26 Aneesh Sathe , Wen Ren Yang

Multi-layer perceptrons (MLP) have proven to be effective scene encoders when combined with higher-dimensional projections of the input, commonly referred to as \textit{positional encoding}. However, scenes with a wide frequency spectrum…

计算机视觉与模式识别 · 计算机科学 2022-06-20 Zoe Landgraf , Alexander Sorkine Hornung , Ricardo Silveira Cabral

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

机器学习 · 计算机科学 2025-12-09 Andrey Savchenko , Oleg Kachan

Multivariate time series (MTS) are ubiquitous in domains such as healthcare, climate science, and industrial monitoring, but their high dimensionality, limited labeled data, and non-stationary nature pose significant challenges for…

机器学习 · 计算机科学 2025-09-09 Jia Wang , Xiao Wang , Chi Zhang

Recently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency…

机器学习 · 计算机科学 2025-06-16 Kun Yi , Qi Zhang , Wei Fan , Longbing Cao , Shoujin Wang , Guodong Long , Liang Hu , Hui He , Qingsong Wen , Hui Xiong

In order to enhance the performance of Transformer models for long-term multivariate forecasting while minimizing computational demands, this paper introduces the Joint Time-Frequency Domain Transformer (JTFT). JTFT combines time and…

机器学习 · 计算机科学 2023-10-31 Yushu Chen , Shengzhuo Liu , Jinzhe Yang , Hao Jing , Wenlai Zhao , Guangwen Yang

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

机器学习 · 计算机科学 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

The field of time series forecasting is rapidly advancing, with recent large-scale Transformers and lightweight Multilayer Perceptron (MLP) models showing strong predictive performance. However, conventional Transformer models are often…

机器学习 · 计算机科学 2025-08-13 Zheng Zhou , Yu-Jie Xiong , Jia-Chen Zhang , Chun-Ming Xia , Xi-Jiong Xie

Time-series forecasting is crucial for numerous real-world applications including weather prediction and financial market modeling. While temporal-domain methods remain prevalent, frequency-domain approaches can effectively capture…

机器学习 · 计算机科学 2025-08-05 Zhixuan Li , Naipeng Chen , Seonghwa Choi , Sanghoon Lee , Weisi Lin