中文
相关论文

相关论文: Kolmogorov-Arnold Attention: Is Learnable Attentio…

200 篇论文

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

机器学习 · 计算机科学 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

机器学习 · 计算机科学 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

The Kolmogorov-Arnold Network (KAN) is a novel multi-layer network model recognized for its efficiency in neuromorphic computing, where synapses between neurons are trained linearly. Computations in KAN are performed by generating a…

量子物理 · 物理学 2025-12-19 Hikaru Wakaura , Rahmat Mulyawan , Andriyan B. Suksmono

Load forecasting plays a crucial role in energy management, directly impacting grid stability, operational efficiency, cost reduction, and environmental sustainability. Traditional Vanilla Recurrent Neural Networks (RNNs) face issues such…

机器学习 · 计算机科学 2025-01-14 Muhammad Umair Danish , Katarina Grolinger

Recent developments have introduced Kolmogorov-Arnold Networks (KAN), an innovative architectural paradigm capable of replicating conventional deep neural network (DNN) capabilities while utilizing significantly reduced parameter counts…

硬件体系结构 · 计算机科学 2025-09-09 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

This paper presents the development and application of Wavelet Kolmogorov-Arnold Networks (Wav-KAN) in federated learning. We implemented Wav-KAN \cite{wav-kan} in the clients. Indeed, we have considered both continuous wavelet transform…

信号处理 · 电气工程与系统科学 2024-05-29 Zavareh Bozorgasl , Hao Chen

Score prediction is crucial in evaluating realistic image sharpness based on collected informative features. Recently, Kolmogorov-Arnold networks (KANs) have been developed and witnessed remarkable success in data fitting. This study…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Shaode Yu , Ze Chen , Zhimu Yang , Jiacheng Gu , Bizu Feng

Existing low-light image enhancement methods are difficult to fit the complex nonlinear relationship between normal and low-light images due to uneven illumination and noise effects. The recently proposed Kolmogorov-Arnold networks (KANs)…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Aoxiang Ning , Minglong Xue , Jinhong He , Chengyun Song

The Kolmogorov-Arnold representation theorem states that any continuous multivariable function can be exactly represented as a finite superposition of continuous single variable functions. Subsequent simplifications of this representation…

机器学习 · 统计学 2025-08-04 Sergei Gleyzer , Hanh Nguyen , Dinesh P. Ramakrishnan , Eric A. F. Reinhardt

Deep neural networks achieve state-of-the-art performance in estimating heterogeneous treatment effects, but their opacity limits trust and adoption in sensitive domains such as medicine, economics, and public policy. Building on…

机器学习 · 统计学 2025-12-08 Alejandro Almodóvar , Patricia A. Apellániz , Santiago Zazo , Juan Parras

Kolmogorov-Arnold networks (KANs) as an alternative to multi-layer perceptrons (MLPs) are a recent development demonstrating strong potential for data-driven modeling. This work applies KANs as the backbone of a neural ordinary differential…

机器学习 · 计算机科学 2024-09-23 Benjamin C. Koenig , Suyong Kim , Sili Deng

Tabular data analysis presents unique challenges that arise from heterogeneous feature types, missing values, and complex feature interactions. While traditional machine learning methods like gradient boosting often outperform deep…

机器学习 · 计算机科学 2025-12-10 Ali Eslamian , Alireza Afzal Aghaei , Qiang Cheng

In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a…

机器学习 · 计算机科学 2024-06-19 Mengxi Liu , Daniel Geißler , Dominique Nshimyimana , Sizhen Bian , Bo Zhou , Paul Lukowicz

Learned activation functions in models like Kolmogorov-Arnold Networks (KANs) outperform fixed-activation architectures in terms of accuracy and interpretability; however, their computational complexity poses critical challenges for…

硬件体系结构 · 计算机科学 2025-08-26 Mengyuan Yin , Benjamin Chen Ming Choong , Chuping Qu , Rick Siow Mong Goh , Weng-Fai Wong , Tao Luo

Kolmogorov-Arnold Networks (KANs) relocate learnable nonlinearities from nodes to edges, demonstrating remarkable capabilities in scientific machine learning and interpretable modeling. However, current KAN implementations suffer from…

神经与进化计算 · 计算机科学 2025-09-25 Alastair Poole , Stig McArthur , Saravan Kumar

The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional…

硬件体系结构 · 计算机科学 2025-04-15 Dhruv Kulkarni , Bharat Bhammar , Henil Thaker , Pranav Dhobi , R. P. Gohil , Sai Manoj Pudukotai Dinkarrao

As key models in geometric deep learning, graph neural networks have demonstrated enormous power in molecular data analysis. Recently, a specially-designed learning scheme, known as Kolmogorov-Arnold Network (KAN), shows unique potential…

机器学习 · 计算机科学 2024-12-19 Longlong Li , Yipeng Zhang , Guanghui Wang , Kelin Xia

Kolmogorov-Arnold Networks (KANs) offer a promising path toward interpretable machine learning: their learnable activations can be studied individually, while collectively fitting complex data accurately. In practice, however, trained…

机器学习 · 计算机科学 2025-12-10 James Bagrow , Josh Bongard

Symbolic discovery of governing equations is a long-standing goal in scientific machine learning, yet a fundamental trade-off persists between interpretability and scalable learning. Classical symbolic regression methods yield explicit…

机器学习 · 计算机科学 2026-03-26 Salah A Faroughi , Farinaz Mostajeran , Amirhossein Arzani , Shirko Faroughi

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful architecture for various machine learning applications. However, their unique structure raises significant concerns regarding their computational overhead. Existing…

机器学习 · 计算机科学 2026-04-07 Bilal Khalid , Pedro Freire , Sergei K. Turitsyn , Jaroslaw E. Prilepsky