English
Related papers

Related papers: MLP-KAN: Unifying Deep Representation and Function…

200 papers

Transformers stand as the cornerstone of mordern deep learning. Traditionally, these models rely on multi-layer perceptron (MLP) layers to mix the information between channels. In this paper, we introduce the Kolmogorov-Arnold Transformer…

Machine Learning · Computer Science 2024-09-18 Xingyi Yang , Xinchao Wang

Kolmogorov-Arnold Networks (KAN) is an emerging neural network architecture in machine learning. It has greatly interested the research community about whether KAN can be a promising alternative of the commonly used Multi-Layer Perceptions…

Machine Learning · Computer Science 2024-09-17 Haihong Guo , Fengxin Li , Jiao Li , Hongyan Liu

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

Machine Learning · Computer Science 2025-03-11 Hoang-Thang Ta , Anh Tran

Inspired by the Kolmogorov-Arnold representation theorem and Kurkova's principle of using approximate representations, we propose the Kurkova-Kolmogorov-Arnold Network (KKAN), a new two-block architecture that combines robust multi-layer…

Machine Learning · Computer Science 2024-12-24 Juan Diego Toscano , Li-Lian Wang , George Em Karniadakis

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

Machine Learning · Computer Science 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis

In traditional neural network architectures, a multilayer perceptron (MLP) is typically employed as a classification block following the feature extraction stage. However, the Kolmogorov-Arnold Network (KAN) presents a promising alternative…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Valeriy Lobanov , Nikita Firsov , Evgeny Myasnikov , Roman Khabibullin , Artem Nikonorov

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Ali Kashefi

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Minjong Cheon

Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or…

Machine Learning · Computer Science 2025-01-24 Eleonora Poeta , Flavio Giobergia , Eliana Pastor , Tania Cerquitelli , Elena Baralis

Kolmogorov-Arnold Networks (KANs), a novel type of neural network, have recently gained popularity and attention due to the ability to substitute multi-layer perceptions (MLPs) in artificial intelligence (AI) with higher accuracy and…

Inspired by the Kolmogorov-Arnold representation theorem, KANs offer a novel framework for function approximation by replacing traditional neural network weights with learnable univariate functions. This design demonstrates significant…

Machine Learning · Computer Science 2025-06-10 Zhangchi Zhao , Jun Shu , Deyu Meng , Zongben Xu

Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distributions, and…

Machine Learning · Computer Science 2026-02-27 Mingming Zhang , Pengfei Shi , Zhiqing Xiao , Feng Zhao , Guandong Sun , Yulin Kang , Ruizhe Gao , Ningtao Wang , Xing Fu , Weiqiang Wang , Junbo Zhao

In this paper, we compare the performance of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptron (MLP) networks on irregular or noisy functions. We control the number of parameters and the size of the training samples to ensure a…

Machine Learning · Computer Science 2024-08-16 Chen Zeng , Jiahui Wang , Haoran Shen , Qiao Wang

The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to…

Computational Physics · Physics 2024-09-06 Rui Wang , Hongyu Yu , Yang Zhong , Hongjun Xiang

DreamerV3 is a state-of-the-art online model-based reinforcement learning (MBRL) algorithm known for remarkable sample efficiency. Concurrently, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-Layer…

Machine Learning · Computer Science 2025-12-09 Chenwei Shi , Xueyu Luan

We study the Kolmogorov-Arnold Network (KAN), recently proposed as an alternative to the classical Multilayer Perceptron (MLP), in the application for differentially private model training. Using the DP-SGD algorithm, we demonstrate that…

Machine Learning · Computer Science 2024-07-18 Nikita P. Kalinin , Simone Bombari , Hossein Zakerinia , Christoph H. Lampert

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and…

Machine Learning · Computer Science 2024-05-28 Moein E. Samadi , Younes Müller , Andreas Schuppert

Federated Kolmogorov-Arnold Networks (F-KANs) have already been proposed, but their assessment is at an initial stage. We present a comparison between KANs (using B-splines and Radial Basis Functions as activation functions) and Multi-…

Machine Learning · Computer Science 2024-10-14 Arthur Mendonça Sasse , Claudio Miceli de Farias

To address the issue of interpretability in multilayer perceptrons (MLPs), Kolmogorov-Arnold Networks (KANs) are introduced in 2024. However, optimizing KAN structures is labor-intensive, typically requiring manual intervention and…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Quan Long , Bin Wang , Bing Xue , Mengjie Zhang

Recently, Kolmogorov-Arnold Networks (KANs) have been proposed as an alternative to multilayer perceptrons, suggesting advantages in performance and interpretability. We study a typical binary event classification task in high-energy…

High Energy Physics - Phenomenology · Physics 2025-05-27 Johannes Erdmann , Florian Mausolf , Jan Lukas Späh