English
Related papers

Related papers: Initialization Schemes for Kolmogorov-Arnold Netwo…

200 papers

Physics-Informed Neural Networks (PINNs) have emerged as a robust framework for solving Partial Differential Equations (PDEs) by approximating their solutions via neural networks and imposing physics-based constraints on the loss function.…

We present a novel approach for verifying properties of Kolmogorov-Arnold Networks (KANs), a class of neural networks characterized by nonlinear, univariate activation functions typically implemented as piecewise polynomial splines or…

Machine Learning · Computer Science 2026-02-09 Noah Schwartz , Chandra Kanth Nagesh , Sriram Sankaranarayanan , Ramneet Kaur , Tuhin Sahai , Susmit Jha

Algorithmic level developments like Convolutional Neural Networks, transformers, attention mechanism, Retrieval Augmented Generation and so on have changed Artificial Intelligence. Recent such development was observed by Kolmogorov-Arnold…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Gating mechanisms are ubiquitous, yet a complementary question in feed-forward networks remains under-explored: how to introduce frequency-rich expressivity without sacrificing stability and scalability? This tension is exposed by…

Machine Learning · Computer Science 2026-02-10 Jusheng Zhang , Yijia Fan , Kaitong Cai , Jing Yang , Yongsen Zheng , Kwok-Yan Lam , Liang Lin , Keze Wang

Traditional constitutive models rely on hand-crafted parametric forms with limited expressivity and generalizability, while neural network-based models can capture complex material behavior but often lack interpretability. To balance these…

Machine Learning · Computer Science 2025-06-05 Prakash Thakolkaran , Yaqi Guo , Shivam Saini , Mathias Peirlinck , Benjamin Alheit , Siddhant Kumar

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao

Despite their immense success, deep convolutional neural networks (CNNs) can be difficult to optimize and costly to train due to hundreds of layers within the network depth. Conventional convolutional operations are fundamentally limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ray Congrui Yu , Sherry Wu , Jiang Gui

Federated Learning (FL) enables model training across decentralized devices without sharing raw data, thereby preserving privacy in sensitive domains like healthcare. In this paper, we evaluate Kolmogorov-Arnold Networks (KAN) architectures…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multilayer Perceptrons (MLPs) in deep learning. KANs have already been integrated into various architectures, such as convolutional neural networks,…

Machine Learning · Computer Science 2025-03-04 Ali Kashefi

The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamental multivariate function. In this work, we investigate the…

Machine Learning · Computer Science 2024-07-31 Mohammed Ghaith Altarabichi

We introduce a novel symbolic regression framework, namely KAN-SR, built on Kolmogorov Arnold Networks (KANs) which follows a divide-and-conquer approach. Symbolic regression searches for mathematical equations that best fit a given dataset…

Machine Learning · Computer Science 2025-09-15 Marco Andrea Bühler , Gonzalo Guillén-Gosálbez

Kolmogorov-Arnold networks (KANs) offer a potent combination of accuracy and interpretability, thanks to their compositions of learnable univariate activation functions. However, the activations of well-fitting KANs tend to exhibit…

Machine Learning · Computer Science 2026-05-05 James Bagrow

This paper presents the application of Kolmogorov-Arnold Networks (KAN) in classifying metal surface defects. Specifically, steel surfaces are analyzed to detect defects such as cracks, inclusions, patches, pitted surfaces, and scratches.…

Machine Learning · Computer Science 2025-01-22 Maciej Krzywda , Mariusz Wermiński , Szymon Łukasik , Amir H. Gandomi

Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. However, transfer learning of KANs remains a relatively…

Machine Learning · Computer Science 2025-02-17 Yihang Gao , Michael K. Ng , Vincent Y. F. Tan

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

Machine Learning · Computer Science 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multi-Layer Perceptrons (MLPs), offering enhanced interpretability and a solid mathematical foundation. However, their parameter efficiency remains a…

Machine Learning · Computer Science 2025-10-09 Di Zhang

Function approximation is a critical task in various fields. However, existing neural network approaches struggle with locally complex or discontinuous functions due to their reliance on a single global model covering the entire problem…

Machine Learning · Computer Science 2025-12-16 Hiroki Shiraishi , Hisao Ishibuchi , Masaya Nakata

Recent advancements in deep learning for image classification predominantly rely on convolutional neural networks (CNNs) or Transformer-based architectures. However, these models face notable challenges in medical imaging, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen