English
Related papers

Related papers: Hardware-Oriented Inference Complexity of Kolmogor…

200 papers

Kolmogorov-Arnold Networks (KAN) \cite{liu2024kan} were very recently proposed as a potential alternative to the prevalent architectural backbone of many deep learning models, the multi-layer perceptron (MLP). KANs have seen success in…

Machine Learning · Computer Science 2025-02-10 Yixuan Wang , Jonathan W. Siegel , Ziming Liu , Thomas Y. Hou

Efforts to improve Kolmogorov--Arnold networks (KANs) with architectural enhancements have been stymied by the complexity those enhancements bring, undermining the interpretability that makes KANs attractive in the first place. Here we…

Machine Learning · Computer Science 2026-04-22 James Bagrow , Josh Bongard

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

As key models in geometric deep learning, graph neural networks have demonstrated enormous power in molecular data analysis. Recently, a specially-designed learning scheme, known as Kolmogorov-Arnold Network (KAN), shows unique potential…

Machine Learning · Computer Science 2024-12-19 Longlong Li , Yipeng Zhang , Guanghui Wang , Kelin Xia

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

Machine Learning · Computer Science 2025-06-24 Ali Kashefi , Tapan Mukerji

Low-latency, resource-efficient neural network inference on FPGAs is essential for applications demanding real-time capability and low power. Lookup table (LUT)-based neural networks are a common solution, combining strong representational…

Hardware Architecture · Computer Science 2026-02-19 Duc Hoang , Aarush Gupta , Philip Harris

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Minjong Cheon

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

There is increasing interest in solving partial differential equations (PDEs) by casting them as machine learning problems. Recently, there has been a spike in exploring Kolmogorov-Arnold Networks (KANs) as an alternative to traditional…

Machine Learning · Computer Science 2025-04-16 Raghav Pant , Sikan Li , Xingjian Li , Hassan Iqbal , Krishna Kumar

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

Machine Learning · Computer Science 2025-03-20 Rodion Novkin , Hussam Amrouch

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

Hardware Architecture · Computer Science 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

Although Kolmogorov-Arnold-based interpretable networks (KANs) possess strong theoretical expressiveness, they suffer from severe parameter explosion and limited ability to capture high-frequency features in high-dimensional tasks. To…

Machine Learning · Computer Science 2026-05-26 Jusheng Zhang , Yijia Fan , Kaitong Cai , Keze Wang , Wenhao Wang

Kolmogorov-Arnold Networks have recently been introduced as a flexible alternative to multi-layer Perceptron architectures. In this paper, we examine the training dynamics of different KAN architectures and compare them with corresponding…

Machine Learning · Computer Science 2024-11-11 Shairoz Sohail

In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a…

Machine Learning · Computer Science 2024-06-19 Mengxi Liu , Daniel Geißler , Dominique Nshimyimana , Sizhen Bian , Bo Zhou , Paul Lukowicz

Manufacturability assessment is a critical step in bridging the persistent gap between design and production. While artificial intelligence (AI) has been widely applied to this task, most existing frameworks rely on geometry-driven methods…

Artificial Intelligence · Computer Science 2026-01-13 Masoud Deylami , Negar Izadipour , Adel Alaeddini

The Kolmogorov-Arnold representation theorem offers a theoretical alternative to Multi-Layer Perceptrons (MLPs) by placing learnable univariate functions on edges rather than nodes. While recent implementations such as Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-01-28 Oscar Eliasson

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao

Kolmogorov-Arnold Networks (KANs) offer a theoretically grounded alternative to multi-layer perceptrons by representing multivariate functions as compositions of univariate basis functions. However, a critical limitation of KANs is the need…

Machine Learning · Computer Science 2026-05-08 Francesco Alesiani , Henrik Christiansen , Federico Errica

The exponential growth of the Internet of Things (IoT) has led to the emergence of substantial security concerns, with IoT networks becoming the primary target for cyberattacks. This study examines the potential of Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-09-12 Natalia Emelianova , Carlos Kamienski , Ronaldo C. Prati

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

Machine Learning · Computer Science 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis