English
Related papers

Related papers: Function Fitting Based on Kolmogorov-Arnold Theore…

200 papers

Kolmogorov-Arnold Networks (KANs) shift neural computation from linear layers to learnable nonlinear edge functions, but implementing these nonlinearities efficiently in hardware remains an open challenge. Here we introduce a physical…

The Kolmogorov-Arnold (KA) representation theorem constructs universal, but highly non-smooth inner functions (the first layer map) in a single (non-linear) hidden layer neural network. Such universal functions have a distinctive local…

Machine Learning · Computer Science 2025-12-03 Michael H. Freedman , Michael Mulligan

In this paper, we introduce FC-KAN, a Kolmogorov-Arnold Network (KAN) that leverages combinations of popular mathematical functions such as B-splines, wavelets, and radial basis functions on low-dimensional data through element-wise…

Machine Learning · Computer Science 2026-03-17 Hoang-Thang Ta , Duy-Quy Thai , Abu Bakar Siddiqur Rahman , Grigori Sidorov , Alexander Gelbukh

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A…

Machine Learning · Statistics 2026-05-22 Roberto Cavoretto , Alessandra De Rossi , Adeeba Haider , Amir Noorizadegan

It is known that any continuous multivariate function can be represented exactly by a composition functions of a single variable - the so-called Kolmogorov-Arnold representation. It can be a convenient tool for tasks where it is required to…

Numerical Analysis · Mathematics 2025-02-04 Michael Poluektov , Andrew Polar

This paper introduces a computational framework to identify nonlinear input-output operators that fit a set of system trajectories while satisfying incremental integral quadratic constraints. The data fitting algorithm is thus regularized…

Optimization and Control · Mathematics 2021-10-25 Henk J. van Waarde , Rodolphe Sepulchre

Kolmogorov-Arnold Networks (KANs) offer a promising framework for approximating complex nonlinear functions, yet the original B-spline formulation suffers from significant computational overhead due to De Boor algorithm. While recent…

Machine Learning · Computer Science 2026-02-10 Shao-Ting Chiu , Siu Wun Cheung , Ulisses Braga-Neto , Chak Shing Lee , Rui Peng Li

For years, many neural networks have been developed based on the Kolmogorov-Arnold Representation Theorem (KART), which was created to address Hilbert's 13th problem. Recently, relying on KART, Kolmogorov-Arnold Networks (KANs) have…

Machine Learning · Computer Science 2025-08-19 Hoang-Thang Ta , Duy-Quy Thai , Phuong-Linh Tran-Thi

The research undertakes a comprehensive comparative analysis of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptrons (MLP), highlighting their effectiveness in solving essential computational challenges like nonlinear function…

Machine Learning · Computer Science 2026-01-16 Aradhya Gaonkar , Nihal Jain , Vignesh Chougule , Nikhil Deshpande , Sneha Varur , Channabasappa Muttal

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

Machine Learning · Computer Science 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

Inspired by the Kolmogorov-Arnold representation theorem and Kurkova's principle of using approximate representations, we propose the Kurkova-Kolmogorov-Arnold Network (KKAN), a new two-block architecture that combines robust multi-layer…

Machine Learning · Computer Science 2024-12-24 Juan Diego Toscano , Li-Lian Wang , George Em Karniadakis

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Although multi-view unsupervised feature selection (MUFS) has demonstrated success in dimensionality reduction for unlabeled multi-view data, most existing methods reduce feature redundancy by focusing on linear correlations among features…

Machine Learning · Computer Science 2026-01-30 Yalan Tan , Yanyong Huang , Zongxin Shen , Dongjie Wang , Fengmao Lv , Tianrui Li

The Convolutional Neural Networks (CNNs) have been the dominant and effective approach for general computer vision tasks. Recently, Kolmogorov-Arnold neural networks (KANs), based on the Kolmogorov-Arnold representation theorem, have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhaoxiang Liu , Zhicheng Ma , Kaikai Zhao , Kai Wang , Shiguo Lian

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

Although Kolmogorov-Arnold-based interpretable networks (KANs) possess strong theoretical expressiveness, they suffer from severe parameter explosion and limited ability to capture high-frequency features in high-dimensional tasks. To…

Machine Learning · Computer Science 2026-05-26 Jusheng Zhang , Yijia Fan , Kaitong Cai , Keze Wang , Wenhao Wang

In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a…

Machine Learning · Computer Science 2024-06-19 Mengxi Liu , Daniel Geißler , Dominique Nshimyimana , Sizhen Bian , Bo Zhou , Paul Lukowicz