中文
相关论文

相关论文: Autocorrelation Reintroduces Spectral Bias in KANs…

200 篇论文

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

机器学习 · 计算机科学 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation…

信号处理 · 电气工程与系统科学 2025-10-28 Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Màrius Caus

Capturing complex temporal patterns and relationships within multivariate data streams is a difficult task. We propose the Temporal Kolmogorov-Arnold Transformer (TKAT), a novel attention-based architecture designed to address this task…

机器学习 · 计算机科学 2024-06-06 Remi Genet , Hugo Inzirillo

Kolmogorov-Arnold Networks (KANs) are highly effective in long-term time series forecasting due to their ability to efficiently represent nonlinear relationships and exhibit local plasticity. However, prior research on KANs has…

机器学习 · 计算机科学 2025-06-17 Xiaoyan Kui , Canwei Liu , Qinsong Li , Zhipeng Hu , Yangyang Shi , Weixin Si , Beiji Zou

Although Kolmogorov-Arnold-based interpretable networks (KANs) possess strong theoretical expressiveness, they suffer from severe parameter explosion and limited ability to capture high-frequency features in high-dimensional tasks. To…

机器学习 · 计算机科学 2026-05-26 Jusheng Zhang , Yijia Fan , Kaitong Cai , Keze Wang , Wenhao Wang

Spectral bias, the tendency of neural networks to prioritize learning low-frequency components of functions during the initial training stages, poses a significant challenge when approximating solutions with high-frequency details. This…

机器学习 · 计算机科学 2025-02-04 Juan Daniel Meshir , Abel Palafox , Edgar Alejandro Guerrero

An increasing body of research focuses on using neural networks to model time series. A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps are uncorrelated.…

机器学习 · 计算机科学 2021-10-12 Fan-Keng Sun , Christopher I. Lang , Duane S. Boning

Recurrent Neural Networks (RNNs) have revolutionized many areas of machine learning, particularly in natural language and data sequence processing. Long Short-Term Memory (LSTM) has demonstrated its ability to capture long-term dependencies…

机器学习 · 计算机科学 2025-08-01 Remi Genet , Hugo Inzirillo

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

机器学习 · 计算机科学 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior…

机器学习 · 计算机科学 2022-01-10 Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

机器学习 · 计算机科学 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Autocorrelation is a defining characteristic of time-series data, where each observation is statistically dependent on its predecessors. In the context of deep time-series forecasting, autocorrelation arises in both the input history and…

Kolmogorov Arnold Networks (KANs) are neural architectures inspired by the Kolmogorov Arnold representation theorem that leverage B Spline parameterizations for flexible, locally adaptive function approximation. Although KANs can capture…

机器学习 · 计算机科学 2025-03-04 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Time series anomaly detection (TSAD) underpins real-time monitoring in cloud services and web systems, allowing rapid identification of anomalies to prevent costly failures. Most TSAD methods driven by forecasting models tend to overfit by…

机器学习 · 计算机科学 2026-05-29 Quan Zhou , Changhua Pei , Fei Sun , Jing Han , Zhengwei Gao , Dan Pei , Haiming Zhang , Gaogang Xie , Jianhui Li

Traditional neural networks struggle to capture the spectral structure of complex signals. Fourier neural networks (FNNs) attempt to address this by embedding Fourier series components, yet many real-world signals are almost-periodic with…

机器学习 · 计算机科学 2026-04-13 Chen Zeng , Tiehang Xu , Qiao Wang

Time Series Forecasting (TSF) is a crucial task in various domains, yet existing TSF models rely heavily on high-quality data and insufficiently exploit all available data. This paper explores a novel self-supervised approach to re-label…

机器学习 · 计算机科学 2025-12-17 Yuxuan Yang , Dalin Zhang , Yuxuan Liang , Hua Lu , Gang Chen , Huan Li

High-Frequency trading (HFT) environments are characterised by large volumes of limit order book (LOB) data, which is notoriously noisy and non-linear. Alpha decay represents a significant challenge, with traditional models such as DeepLOB…

机器学习 · 计算机科学 2026-01-07 Ahmad Makinde

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao

Functional connectivity (FC) analysis, a valuable tool for computer-aided brain disorder diagnosis, traditionally relies on atlas-based parcellation. However, issues relating to selection bias and a lack of regard for subject specificity…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Tyler Ward , Abdullah Imran

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

机器学习 · 计算机科学 2022-02-15 Li Shen , Yangzhu Wang
‹ 上一页 1 2 3 10 下一页 ›