English
Related papers

Related papers: Kolmogorov-Arnold Attention: Is Learnable Attentio…

200 papers

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

The Kolmogorov-Arnold Network (KAN) is a novel multi-layer network model recognized for its efficiency in neuromorphic computing, where synapses between neurons are trained linearly. Computations in KAN are performed by generating a…

Quantum Physics · Physics 2025-12-19 Hikaru Wakaura , Rahmat Mulyawan , Andriyan B. Suksmono

Load forecasting plays a crucial role in energy management, directly impacting grid stability, operational efficiency, cost reduction, and environmental sustainability. Traditional Vanilla Recurrent Neural Networks (RNNs) face issues such…

Machine Learning · Computer Science 2025-01-14 Muhammad Umair Danish , Katarina Grolinger

Recent developments have introduced Kolmogorov-Arnold Networks (KAN), an innovative architectural paradigm capable of replicating conventional deep neural network (DNN) capabilities while utilizing significantly reduced parameter counts…

Hardware Architecture · Computer Science 2025-09-09 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

This paper presents the development and application of Wavelet Kolmogorov-Arnold Networks (Wav-KAN) in federated learning. We implemented Wav-KAN \cite{wav-kan} in the clients. Indeed, we have considered both continuous wavelet transform…

Signal Processing · Electrical Eng. & Systems 2024-05-29 Zavareh Bozorgasl , Hao Chen

Score prediction is crucial in evaluating realistic image sharpness based on collected informative features. Recently, Kolmogorov-Arnold networks (KANs) have been developed and witnessed remarkable success in data fitting. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaode Yu , Ze Chen , Zhimu Yang , Jiacheng Gu , Bizu Feng

Existing low-light image enhancement methods are difficult to fit the complex nonlinear relationship between normal and low-light images due to uneven illumination and noise effects. The recently proposed Kolmogorov-Arnold networks (KANs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Aoxiang Ning , Minglong Xue , Jinhong He , Chengyun Song

The Kolmogorov-Arnold representation theorem states that any continuous multivariable function can be exactly represented as a finite superposition of continuous single variable functions. Subsequent simplifications of this representation…

Machine Learning · Statistics 2025-08-04 Sergei Gleyzer , Hanh Nguyen , Dinesh P. Ramakrishnan , Eric A. F. Reinhardt

Deep neural networks achieve state-of-the-art performance in estimating heterogeneous treatment effects, but their opacity limits trust and adoption in sensitive domains such as medicine, economics, and public policy. Building on…

Machine Learning · Statistics 2025-12-08 Alejandro Almodóvar , Patricia A. Apellániz , Santiago Zazo , Juan Parras

Kolmogorov-Arnold networks (KANs) as an alternative to multi-layer perceptrons (MLPs) are a recent development demonstrating strong potential for data-driven modeling. This work applies KANs as the backbone of a neural ordinary differential…

Machine Learning · Computer Science 2024-09-23 Benjamin C. Koenig , Suyong Kim , Sili Deng

Tabular data analysis presents unique challenges that arise from heterogeneous feature types, missing values, and complex feature interactions. While traditional machine learning methods like gradient boosting often outperform deep…

Machine Learning · Computer Science 2025-12-10 Ali Eslamian , Alireza Afzal Aghaei , Qiang Cheng

In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a…

Machine Learning · Computer Science 2024-06-19 Mengxi Liu , Daniel Geißler , Dominique Nshimyimana , Sizhen Bian , Bo Zhou , Paul Lukowicz

Learned activation functions in models like Kolmogorov-Arnold Networks (KANs) outperform fixed-activation architectures in terms of accuracy and interpretability; however, their computational complexity poses critical challenges for…

Hardware Architecture · Computer Science 2025-08-26 Mengyuan Yin , Benjamin Chen Ming Choong , Chuping Qu , Rick Siow Mong Goh , Weng-Fai Wong , Tao Luo

Kolmogorov-Arnold Networks (KANs) relocate learnable nonlinearities from nodes to edges, demonstrating remarkable capabilities in scientific machine learning and interpretable modeling. However, current KAN implementations suffer from…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Alastair Poole , Stig McArthur , Saravan Kumar

The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional…

Hardware Architecture · Computer Science 2025-04-15 Dhruv Kulkarni , Bharat Bhammar , Henil Thaker , Pranav Dhobi , R. P. Gohil , Sai Manoj Pudukotai Dinkarrao

As key models in geometric deep learning, graph neural networks have demonstrated enormous power in molecular data analysis. Recently, a specially-designed learning scheme, known as Kolmogorov-Arnold Network (KAN), shows unique potential…

Machine Learning · Computer Science 2024-12-19 Longlong Li , Yipeng Zhang , Guanghui Wang , Kelin Xia

Kolmogorov-Arnold Networks (KANs) offer a promising path toward interpretable machine learning: their learnable activations can be studied individually, while collectively fitting complex data accurately. In practice, however, trained…

Machine Learning · Computer Science 2025-12-10 James Bagrow , Josh Bongard

Symbolic discovery of governing equations is a long-standing goal in scientific machine learning, yet a fundamental trade-off persists between interpretability and scalable learning. Classical symbolic regression methods yield explicit…

Machine Learning · Computer Science 2026-03-26 Salah A Faroughi , Farinaz Mostajeran , Amirhossein Arzani , Shirko Faroughi

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful architecture for various machine learning applications. However, their unique structure raises significant concerns regarding their computational overhead. Existing…

Machine Learning · Computer Science 2026-04-07 Bilal Khalid , Pedro Freire , Sergei K. Turitsyn , Jaroslaw E. Prilepsky