English
Related papers

Related papers: Architectural Scaling Surpass Basis Complexity? Ef…

200 papers

Although Kolmogorov-Arnold-based interpretable networks (KANs) possess strong theoretical expressiveness, they suffer from severe parameter explosion and limited ability to capture high-frequency features in high-dimensional tasks. To…

Machine Learning · Computer Science 2026-05-26 Jusheng Zhang , Yijia Fan , Kaitong Cai , Keze Wang , Wenhao Wang

We analyze the universal approximation property of Kolmogorov-Arnold Networks (KANs) in terms of their edge functions. If these functions are all affine, then universality clearly fails. How many non-affine functions are needed, in addition…

Machine Learning · Computer Science 2026-05-19 Vugar Ismailov

Kolmogorov-Arnold Networks (KANs) have recently shown promise for solving partial differential equations (PDEs). Yet their original formulation is computationally and memory intensive, motivating the introduction of Chebyshev Type-I-based…

Machine Learning · Computer Science 2026-01-19 Hangwei Zhang , Zhimu Huang , Yan Wang

Recent advancements in deep learning for image classification predominantly rely on convolutional neural networks (CNNs) or Transformer-based architectures. However, these models face notable challenges in medical imaging, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they…

Numerical Analysis · Mathematics 2025-01-22 Zhiwei Gao , George Em Karniadakis

Kolmogorov-Arnold networks (KANs) have attracted attention recently as an alternative to multilayer perceptrons (MLPs) for scientific machine learning. However, KANs can be expensive to train, even for relatively small networks. Inspired by…

Machine Learning · Computer Science 2025-11-18 Amanda A. Howard , Bruno Jacob , Sarah Helfert , Alexander Heinlein , Panos Stinis

This short paper is a fast proof-of-concept that the 3-order B-splines used in Kolmogorov-Arnold Networks (KANs) can be well approximated by Gaussian radial basis functions. Doing so leads to FastKAN, a much faster implementation of KAN…

Machine Learning · Computer Science 2024-05-14 Ziyao Li

Kolmogorov-Arnold Networks (KANs) require significantly smaller architectures compared to multilayer perceptron (MLP)-based approaches, while retaining expressive power through spline-based activations. Moving boundary problems are…

Mathematical Physics · Physics 2026-02-10 Tarus Pande , V M S K Minnikanti , Shyamprasad Karagadde

Score prediction is crucial in evaluating realistic image sharpness based on collected informative features. Recently, Kolmogorov-Arnold networks (KANs) have been developed and witnessed remarkable success in data fitting. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaode Yu , Ze Chen , Zhimu Yang , Jiacheng Gu , Bizu Feng

Kolmogorov-Arnold Networks (KANs) have recently emerged as a promising alternative to traditional neural architectures, yet their application to speech processing remains under explored. This work presents the first investigation of KANs…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Eliana Pastor , Sabato Marco Siniscalchi , Elena Baralis

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) offer a promising path toward interpretable machine learning: their learnable activations can be studied individually, while collectively fitting complex data accurately. In practice, however, trained…

Machine Learning · Computer Science 2025-12-10 James Bagrow , Josh Bongard

Lightweight neural network accelerators are essential for edge devices with limited resources and power constraints. While quantization and binarization can efficiently reduce hardware cost, they still rely on the conventional Artificial…

Hardware Architecture · Computer Science 2026-03-02 Yuhao Liu , Salim Ullah , Akash Kumar

Physics-Informed Neural Networks (PINNs) have become a popular and powerful framework for solving partial differential equations (PDEs), leveraging neural networks to approximate solutions while embedding PDE constraints, boundary…

Numerical Analysis · Mathematics 2026-02-03 Zijuan Xin , Chenyao Wang , Feng Shi , Yizhong Sun

Quantum architecture Search (QAS) is a promising direction for optimization and automated design of quantum circuits towards quantum advantage. Recent techniques in QAS emphasize Multi-Layer Perceptron (MLP)-based deep Q-networks. However,…

Quantum Physics · Physics 2024-12-13 Akash Kundu , Aritra Sarkar , Abhishek Sadhu

We introduce a novel symbolic regression framework, namely KAN-SR, built on Kolmogorov Arnold Networks (KANs) which follows a divide-and-conquer approach. Symbolic regression searches for mathematical equations that best fit a given dataset…

Machine Learning · Computer Science 2025-09-15 Marco Andrea Bühler , Gonzalo Guillén-Gosálbez

Limited by the complexity of basis function (B-spline) calculations, Kolmogorov-Arnold Networks (KAN) suffer from restricted parallel computing capability on GPUs. This paper proposes a novel ReLU-KAN implementation that inherits the core…

Machine Learning · Computer Science 2024-08-13 Qi Qiu , Tao Zhu , Helin Gong , Liming Chen , Huansheng Ning

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

Machine Learning · Computer Science 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Kolmogorov Arnold Networks (KANs) are neural architectures inspired by the Kolmogorov Arnold representation theorem that leverage B Spline parameterizations for flexible, locally adaptive function approximation. Although KANs can capture…

Machine Learning · Computer Science 2025-03-04 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Synthetic Aperture Radar (SAR) image recognition is vital for disaster monitoring, military reconnaissance, and ocean observation. However, large SAR image sizes hinder deep learning deployment on resource-constrained edge devices, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Pan Yi , Weijie Li , Xiaodong Chen , Jiehua Zhang , Li Liu , Yongxiang Liu