English
Related papers

Related papers: KAN versus MLP on Irregular or Noisy Functions

200 papers

Multilayer Perceptrons (MLPs) have long been a cornerstone in deep learning, known for their capacity to model complex relationships. Recently, Kolmogorov-Arnold Networks (KANs) have emerged as a compelling alternative, utilizing highly…

Machine Learning · Computer Science 2024-09-17 Farhad Pourkamali-Anaraki

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

The research undertakes a comprehensive comparative analysis of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptrons (MLP), highlighting their effectiveness in solving essential computational challenges like nonlinear function…

Machine Learning · Computer Science 2026-01-16 Aradhya Gaonkar , Nihal Jain , Vignesh Chougule , Nikhil Deshpande , Sneha Varur , Channabasappa Muttal

Kolmogorov-Arnold Networks (KAN) \cite{liu2024kan} were very recently proposed as a potential alternative to the prevalent architectural backbone of many deep learning models, the multi-layer perceptron (MLP). KANs have seen success in…

Machine Learning · Computer Science 2025-02-10 Yixuan Wang , Jonathan W. Siegel , Ziming Liu , Thomas Y. Hou

Deep learning has long been dominated by multi-layer perceptrons (MLPs), which have demonstrated superiority over other optimizable models in various domains. Recently, a new alternative to MLPs has emerged - Kolmogorov-Arnold Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alessandro Cacciatore , Valerio Morelli , Federica Paganica , Emanuele Frontoni , Lucia Migliorelli , Daniele Berardini

Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or…

Machine Learning · Computer Science 2025-01-24 Eleonora Poeta , Flavio Giobergia , Eliana Pastor , Tania Cerquitelli , Elena Baralis

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Minjong Cheon

Kolmogorov-Arnold Networks (KANs) have gained significant attention as an alternative to traditional multilayer perceptrons, with proponents claiming superior interpretability and performance through learnable univariate activation…

Machine Learning · Computer Science 2025-09-16 Yuntian Hou , Tianrui Ji , Di Zhang , Angelos Stefanidis

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

Machine Learning · Computer Science 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

Federated Kolmogorov-Arnold Networks (F-KANs) have already been proposed, but their assessment is at an initial stage. We present a comparison between KANs (using B-splines and Radial Basis Functions as activation functions) and Multi-…

Machine Learning · Computer Science 2024-10-14 Arthur Mendonça Sasse , Claudio Miceli de Farias

Kolmogorov-Arnold Networks have recently been introduced as a flexible alternative to multi-layer Perceptron architectures. In this paper, we examine the training dynamics of different KAN architectures and compare them with corresponding…

Machine Learning · Computer Science 2024-11-11 Shairoz Sohail

Kolmogorov-Arnold Networks (KAN) has recently attracted significant attention as a promising alternative to traditional Multi-Layer Perceptrons (MLP). Despite their theoretical appeal, KAN require validation on large-scale benchmark…

Machine Learning · Computer Science 2024-09-12 Chang Dong , Liangwei Zheng , Weitong Chen

The field of scientific machine learning, which originally utilized multilayer perceptrons (MLPs), is increasingly adopting Kolmogorov-Arnold Networks (KANs) for data encoding. This shift is driven by the limitations of MLPs, including poor…

Machine Learning · Computer Science 2025-11-04 Salah A. Faroughi , Farinaz Mostajeran , Amin Hamed Mashhadzadeh , Shirko Faroughi

The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold…

Machine Learning · Computer Science 2024-12-19 Ruichen Qiu , Yibo Miao , Shiwen Wang , Lijia Yu , Yifan Zhu , Xiao-Shan Gao

Recently, Kolmogorov-Arnold Networks (KANs) have been proposed as an alternative to multilayer perceptrons, suggesting advantages in performance and interpretability. We study a typical binary event classification task in high-energy…

High Energy Physics - Phenomenology · Physics 2025-05-27 Johannes Erdmann , Florian Mausolf , Jan Lukas Späh

Kolmogorov-Arnold Networks (KANs), a novel type of neural network, have recently gained popularity and attention due to the ability to substitute multi-layer perceptions (MLPs) in artificial intelligence (AI) with higher accuracy and…

In traditional neural network architectures, a multilayer perceptron (MLP) is typically employed as a classification block following the feature extraction stage. However, the Kolmogorov-Arnold Network (KAN) presents a promising alternative…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Valeriy Lobanov , Nikita Firsov , Evgeny Myasnikov , Roman Khabibullin , Artem Nikonorov

This paper tests whether Kolmogorov--Arnold Networks (KAN 2.0) are genuinely more noise-robust than Multi-Layer Perceptrons (MLP) and XGBoost for stellar classification (star/galaxy/quasar, 100,000 SDSS DR17 objects). A naive comparison…

Instrumentation and Methods for Astrophysics · Physics 2026-05-29 Kristian Sestak

We study the Kolmogorov-Arnold Network (KAN), recently proposed as an alternative to the classical Multilayer Perceptron (MLP), in the application for differentially private model training. Using the DP-SGD algorithm, we demonstrate that…

Machine Learning · Computer Science 2024-07-18 Nikita P. Kalinin , Simone Bombari , Hossein Zakerinia , Christoph H. Lampert
‹ Prev 1 2 3 10 Next ›