English
Related papers

Related papers: KAN versus MLP on Irregular or Noisy Functions

200 papers

There is increasing interest in solving partial differential equations (PDEs) by casting them as machine learning problems. Recently, there has been a spike in exploring Kolmogorov-Arnold Networks (KANs) as an alternative to traditional…

Machine Learning · Computer Science 2025-04-16 Raghav Pant , Sikan Li , Xingjian Li , Hassan Iqbal , Krishna Kumar

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and…

Machine Learning · Computer Science 2024-05-28 Moein E. Samadi , Younes Müller , Andreas Schuppert

Recent advancements in both representation learning and function learning have demonstrated substantial promise across diverse domains of artificial intelligence. However, the effective integration of these paradigms poses a significant…

Machine Learning · Computer Science 2024-10-07 Yunhong He , Yifeng Xie , Zhengqing Yuan , Lichao Sun

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

Machine Learning · Computer Science 2025-03-11 Hoang-Thang Ta , Anh Tran

Algorithmic speedup of training common neural architectures is made difficult by the lack of structure guaranteed by the function compositions inherent to such networks. In contrast to multilayer perceptrons (MLPs), Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-03-06 Ben S. Southworth , Jonas A. Actor , Graham Harper , Eric C. Cyr

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

Kolmogorov-Arnold Networks (KANs) have garnered attention for replacing fixed activation functions with learnable univariate functions, but they exhibit practical limitations, including high computational costs and performance deficits in…

Machine Learning · Computer Science 2025-07-08 Hanseon Joo , Hayoung Choi , Ook Lee , Minjong Cheon

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2024-10-04 Mohammadamin Moradi , Shirin Panahi , Erik Bollt , Ying-Cheng Lai

Kolmogorov Arnold Networks (KANs) are recent architectural advancement in neural computation that offer a mathematically grounded alternative to standard neural networks. This study presents an empirical evaluation of KANs in context of…

Machine Learning · Computer Science 2025-07-21 Pankaj Yadav , Vivek Vijay

The recently proposed Kolmogorov-Arnold network (KAN) is a promising alternative to multi-layer perceptrons (MLPs) for data-driven modeling. While original KAN layers were only capable of representing the addition operator, the…

Machine Learning · Computer Science 2025-07-28 Benjamin C. Koenig , Suyong Kim , Sili Deng

The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to…

Computational Physics · Physics 2024-09-06 Rui Wang , Hongyu Yu , Yang Zhong , Hongjun Xiang

Deep learning neural networks architectures such Multi Layer Perceptrons (MLP) and Convolutional blocks still play a crucial role in nowadays research advancements. From a topological point of view, these architecture may be represented as…

Machine Learning · Computer Science 2025-07-29 Ugo Lomoio , Pierangelo Veltri , Pietro Hiram Guzzi

In this paper, we present an innovative federated learning (FL) approach that utilizes Kolmogorov-Arnold Networks (KANs) for classification tasks. By utilizing the adaptive activation capabilities of KANs in a federated framework, we aim to…

Machine Learning · Computer Science 2024-11-12 Engin Zeydan , Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Marius Caus , Abdullah Aydeger

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

Machine Learning · Computer Science 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis

Kolmogorov-Arnold Networks (KANs) offer a theoretically grounded alternative to multi-layer perceptrons by representing multivariate functions as compositions of univariate basis functions. However, a critical limitation of KANs is the need…

Machine Learning · Computer Science 2026-05-08 Francesco Alesiani , Henrik Christiansen , Federico Errica

Kolmogorov-Arnold Networks (KAN) are a new class of neural network architecture representing a promising alternative to the Multilayer Perceptron (MLP), demonstrating improved expressiveness and interpretability. However, KANs suffer from…

Machine Learning · Computer Science 2025-03-04 Cale Coffman , Lizhong Chen

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

Machine Learning · Computer Science 2024-09-04 Victor Augusto Kich , Jair Augusto Bottega , Raul Steinmetz , Ricardo Bedin Grando , Ayano Yorozu , Akihisa Ohya

Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ali Jamali , Swalpa Kumar Roy , Danfeng Hong , Bing Lu , Pedram Ghamisi

Multi-Layer Perceptrons (MLPs) rely on pre-defined, fixed activation functions, imposing a static inductive bias that forces the network to approximate complex topologies solely through increased depth and width. Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2026-03-10 Andrés Ortiz , Nicolás J. Gallego-Molina , Carmen Jiménez-Mesa , Juan M. Górriz , Javier Ramírez