English
Related papers

Related papers: Physical Analogue Kolmogorov-Arnold Networks based…

200 papers

Physical neural networks typically train linear synaptic weights while treating device nonlinearities as fixed. We show the opposite - by training the synaptic nonlinearity itself, as in Kolmogorov-Arnold Network (KAN) architectures, we…

Learned activation functions in models like Kolmogorov-Arnold Networks (KANs) outperform fixed-activation architectures in terms of accuracy and interpretability; however, their computational complexity poses critical challenges for…

Hardware Architecture · Computer Science 2025-08-26 Mengyuan Yin , Benjamin Chen Ming Choong , Chuping Qu , Rick Siow Mong Goh , Weng-Fai Wong , Tao Luo

Recent developments have introduced Kolmogorov-Arnold Networks (KAN), an innovative architectural paradigm capable of replicating conventional deep neural network (DNN) capabilities while utilizing significantly reduced parameter counts…

Hardware Architecture · Computer Science 2025-09-09 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Kolmogorov-Arnold Networks (KANs) relocate learnable nonlinearities from nodes to edges, demonstrating remarkable capabilities in scientific machine learning and interpretable modeling. However, current KAN implementations suffer from…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Alastair Poole , Stig McArthur , Saravan Kumar

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

This systematic review explores the theoretical foundations, evolution, applications, and future potential of Kolmogorov-Arnold Networks (KAN), a neural network model inspired by the Kolmogorov-Arnold representation theorem. KANs…

Machine Learning · Computer Science 2025-06-09 Shriyank Somvanshi , Syed Aaqib Javed , Md Monzurul Islam , Diwas Pandit , Subasish Das

Fully analogue neural computation requires hardware that can implement both linear and nonlinear transformations without digital assistance. While analogue in-memory computing efficiently realizes matrix-vector multiplication, the absence…

Emerging Technologies · Computer Science 2025-12-29 Songyuan Li , Teng Wang , Jinrong Tang , Ruiqi Liu , Haoyu Li , Yuyao Lu , Feng Xu , Bin Gao , Can Xie , Xiangwei Zhu

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

Kolmogorov-Arnold Networks (KANs) have gained significant attention as an alternative to traditional multilayer perceptrons, with proponents claiming superior interpretability and performance through learnable univariate activation…

Machine Learning · Computer Science 2025-09-16 Yuntian Hou , Tianrui Ji , Di Zhang , Angelos Stefanidis

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By replacing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Alexander Dylan Bodner , Antonio Santiago Tepsich , Jack Natan Spolski , Santiago Pourteau

The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to…

Computational Physics · Physics 2024-09-06 Rui Wang , Hongyu Yu , Yang Zhong , Hongjun Xiang

This paper presents an experimental study of Kolmogorov-Arnold Networks (KANs) applied to computer vision tasks, particularly image classification. KANs introduce learnable activation functions on edges, offering flexible non-linear…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Karthik Mohan , Hanxiao Wang , Xiatian Zhu

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

Machine Learning · Computer Science 2025-03-20 Rodion Novkin , Hussam Amrouch

Kolmogorov-Arnold Networks (KANs) introduce a paradigm of neural modeling that implements learnable functions on the edges of the networks, diverging from the traditional node-centric activations in neural networks. This work assesses the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Basim Azam , Naveed Akhtar

The research undertakes a comprehensive comparative analysis of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptrons (MLP), highlighting their effectiveness in solving essential computational challenges like nonlinear function…

Machine Learning · Computer Science 2026-01-16 Aradhya Gaonkar , Nihal Jain , Vignesh Chougule , Nikhil Deshpande , Sneha Varur , Channabasappa Muttal

Low-latency, resource-efficient neural network inference on FPGAs is essential for applications demanding real-time capability and low power. Lookup table (LUT)-based neural networks are a common solution, combining strong representational…

Hardware Architecture · Computer Science 2026-02-19 Duc Hoang , Aarush Gupta , Philip Harris

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful architecture for various machine learning applications. However, their unique structure raises significant concerns regarding their computational overhead. Existing…

Machine Learning · Computer Science 2026-04-07 Bilal Khalid , Pedro Freire , Sergei K. Turitsyn , Jaroslaw E. Prilepsky

Kolmogorov-Arnold Networks (KANs) were proposed as an alternative to traditional neural network architectures based on multilayer perceptrons (MLP-NNs). The potential advantages of KANs over MLP-NNs, including significantly enhanced…

Materials Science · Physics 2026-01-29 Ryan Jacobs , Lane E. Schultz , Dane Morgan

Transformers stand as the cornerstone of mordern deep learning. Traditionally, these models rely on multi-layer perceptron (MLP) layers to mix the information between channels. In this paper, we introduce the Kolmogorov-Arnold Transformer…

Machine Learning · Computer Science 2024-09-18 Xingyi Yang , Xinchao Wang

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful alternative to traditional multilayer perceptrons. However, their reliance on predefined, bounded grids restricts their ability to approximate functions on unbounded…

Machine Learning · Computer Science 2025-10-10 Alireza Moradzadeh , Srimukh Prasad Veccham , Lukasz Wawrzyniak , Miles Macklin , Saee G. Paliwal
‹ Prev 1 2 3 10 Next ›