English
Related papers

Related papers: Layer-wise Lipschitz-Product Control for Deep Kolm…

200 papers

Although Kolmogorov-Arnold-based interpretable networks (KANs) possess strong theoretical expressiveness, they suffer from severe parameter explosion and limited ability to capture high-frequency features in high-dimensional tasks. To…

Machine Learning · Computer Science 2026-05-26 Jusheng Zhang , Yijia Fan , Kaitong Cai , Keze Wang , Wenhao Wang

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By replacing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Alexander Dylan Bodner , Antonio Santiago Tepsich , Jack Natan Spolski , Santiago Pourteau

Kolmogorov-Arnold Networks (KANs) have gained attention for their potential to outperform Multi-Layer Perceptrons (MLPs) in terms of parameter efficiency and interpretability. Unlike traditional MLPs, KANs use learnable non-linear…

Hardware Architecture · Computer Science 2026-03-19 Sohaib Errabii , Olivier Sentieys , Marcello Traiola

We establish universality and expression rate bounds for a class of neural Deep Operator Networks (DON) emulating Lipschitz (or H\"older) continuous maps $\mathcal G:\mathcal X\to\mathcal Y$ between (subsets of) separable Hilbert spaces…

Numerical Analysis · Mathematics 2023-07-20 Christoph Schwab , Andreas Stein , Jakob Zech

Kolmogorov-Arnold Networks (KANs) shift neural computation from linear layers to learnable nonlinear edge functions, but implementing these nonlinearities efficiently in hardware remains an open challenge. Here we introduce a physical…

Kolmogorov famously proved that multivariate continuous functions can be represented as a superposition of a small number of univariate continuous functions, $$ f(x_1,\dots,x_n) = \sum_{q=0}^{2n+1} \chi^q \left( \sum_{p=1}^n \psi^{pq}(x_p)…

Numerical Analysis · Mathematics 2017-12-25 Jonas Actor , Matthew G. Knepley

Despite their immense success, deep convolutional neural networks (CNNs) can be difficult to optimize and costly to train due to hundreds of layers within the network depth. Conventional convolutional operations are fundamentally limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ray Congrui Yu , Sherry Wu , Jiang Gui

Kolmogorov-Arnold networks (KANs) offer a potent combination of accuracy and interpretability, thanks to their compositions of learnable univariate activation functions. However, the activations of well-fitting KANs tend to exhibit…

Machine Learning · Computer Science 2026-05-05 James Bagrow

Kolmogorov-Arnold Networks (KANs) were proposed as an alternative to traditional neural network architectures based on multilayer perceptrons (MLP-NNs). The potential advantages of KANs over MLP-NNs, including significantly enhanced…

Materials Science · Physics 2026-01-29 Ryan Jacobs , Lane E. Schultz , Dane Morgan

Recent work has established an alternative to traditional multi-layer perceptron neural networks in the form of Kolmogorov-Arnold Networks (KAN). The general KAN framework uses learnable activation functions on the edges of the…

Machine Learning · Computer Science 2025-01-28 Eric A. F. Reinhardt , P. R. Dinesh , Sergei Gleyzer

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

Machine Learning · Computer Science 2024-09-04 Victor Augusto Kich , Jair Augusto Bottega , Raul Steinmetz , Ricardo Bedin Grando , Ayano Yorozu , Akihisa Ohya

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

Machine Learning · Computer Science 2025-03-11 Hoang-Thang Ta , Anh Tran

Kolmogorov-Arnold Networks (KAN) models were recently proposed and claimed to provide improved parameter scaling and interpretability compared to conventional multilayer perceptron (MLP) models. Inspired by the KAN architecture, we propose…

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

Machine Learning · Computer Science 2025-06-24 Ali Kashefi , Tapan Mukerji

By utilising their adaptive activation functions, Kolmogorov-Arnold Networks (KANs) can be applied in a novel way for the diverse machine learning tasks, including cyber threat detection. KANs substitute conventional linear weights with…

Cryptography and Security · Computer Science 2026-04-01 Mohammed Hassanin

This paper explores the expressive power of deep neural networks through the framework of function compositions. We demonstrate that the repeated compositions of a single fixed-size ReLU network exhibit surprising expressive power, despite…

Machine Learning · Computer Science 2023-08-01 Shijun Zhang , Jianfeng Lu , Hongkai Zhao

Functional connectivity (FC) analysis, a valuable tool for computer-aided brain disorder diagnosis, traditionally relies on atlas-based parcellation. However, issues relating to selection bias and a lack of regard for subject specificity…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Tyler Ward , Abdullah Imran

Recently, Kolmogorov-Arnold Networks (KANs) have been proposed as an alternative to multilayer perceptrons, suggesting advantages in performance and interpretability. We study a typical binary event classification task in high-energy…

High Energy Physics - Phenomenology · Physics 2025-05-27 Johannes Erdmann , Florian Mausolf , Jan Lukas Späh