English
Related papers

Related papers: Multilevel Training for Kolmogorov Arnold Networks

200 papers

Multi-layer perceptrons (MLP's) have been extensively utilized in discovering Deep Koopman operators for linearizing nonlinear dynamics. With the emergence of Kolmogorov-Arnold Networks (KANs) as a more efficient and accurate alternative to…

Machine Learning · Computer Science 2024-08-13 George Nehma , Madhur Tiwari

Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or…

Machine Learning · Computer Science 2025-01-24 Eleonora Poeta , Flavio Giobergia , Eliana Pastor , Tania Cerquitelli , Elena Baralis

Kolmogorov-Arnold Networks (KANs) are a recently introduced neural architecture that replace fixed nonlinearities with trainable activation functions, offering enhanced flexibility and interpretability. While KANs have been applied…

Machine Learning · Computer Science 2026-03-31 Spyros Rigas , Dhruv Verma , Georgios Alexandridis , Yixuan Wang

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

Machine Learning · Computer Science 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

This systematic review explores the theoretical foundations, evolution, applications, and future potential of Kolmogorov-Arnold Networks (KAN), a neural network model inspired by the Kolmogorov-Arnold representation theorem. KANs…

Machine Learning · Computer Science 2025-06-09 Shriyank Somvanshi , Syed Aaqib Javed , Md Monzurul Islam , Diwas Pandit , Subasish Das

Kolmogorov-Arnold networks (KANs) as an alternative to multi-layer perceptrons (MLPs) are a recent development demonstrating strong potential for data-driven modeling. This work applies KANs as the backbone of a neural ordinary differential…

Machine Learning · Computer Science 2024-09-23 Benjamin C. Koenig , Suyong Kim , Sili Deng

Kolmogorov-Arnold Networks (KANs) are a recent neural network architecture offering an alternative to Multilayer Perceptrons (MLPs) with improved explainability and expressibility. However, KANs are significantly slower than MLPs due to the…

Machine Learning · Computer Science 2026-04-27 Eduardo Said Merin-Martinez , Andres Mendez-Vazquez , Eduardo Rodriguez-Tello

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By replacing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Alexander Dylan Bodner , Antonio Santiago Tepsich , Jack Natan Spolski , Santiago Pourteau

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

Machine Learning · Computer Science 2024-09-04 Victor Augusto Kich , Jair Augusto Bottega , Raul Steinmetz , Ricardo Bedin Grando , Ayano Yorozu , Akihisa Ohya

Deep learning neural networks architectures such Multi Layer Perceptrons (MLP) and Convolutional blocks still play a crucial role in nowadays research advancements. From a topological point of view, these architecture may be represented as…

Machine Learning · Computer Science 2025-07-29 Ugo Lomoio , Pierangelo Veltri , Pietro Hiram Guzzi

Multi-Layer Perceptrons (MLPs) rely on pre-defined, fixed activation functions, imposing a static inductive bias that forces the network to approximate complex topologies solely through increased depth and width. Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2026-03-10 Andrés Ortiz , Nicolás J. Gallego-Molina , Carmen Jiménez-Mesa , Juan M. Górriz , Javier Ramírez

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

Machine Learning · Computer Science 2025-03-11 Hoang-Thang Ta , Anh Tran

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2024-10-04 Mohammadamin Moradi , Shirin Panahi , Erik Bollt , Ying-Cheng Lai

Recently, Kolmogorov-Arnold Networks (KANs) have been proposed as an alternative to multilayer perceptrons, suggesting advantages in performance and interpretability. We study a typical binary event classification task in high-energy…

High Energy Physics - Phenomenology · Physics 2025-05-27 Johannes Erdmann , Florian Mausolf , Jan Lukas Späh

The recently proposed Kolmogorov-Arnold network (KAN) is a promising alternative to multi-layer perceptrons (MLPs) for data-driven modeling. While original KAN layers were only capable of representing the addition operator, the…

Machine Learning · Computer Science 2025-07-28 Benjamin C. Koenig , Suyong Kim , Sili Deng

There is increasing interest in solving partial differential equations (PDEs) by casting them as machine learning problems. Recently, there has been a spike in exploring Kolmogorov-Arnold Networks (KANs) as an alternative to traditional…

Machine Learning · Computer Science 2025-04-16 Raghav Pant , Sikan Li , Xingjian Li , Hassan Iqbal , Krishna Kumar

Kolmogorov-Arnold Networks (KANs) are a class of neural networks that have received increased attention in recent literature. In contrast to MLPs, KANs leverage parameterized, trainable activation functions and offer several benefits…

Machine Learning · Computer Science 2025-11-14 Jamison Moody , James Usevitch

Kolmogorov-Arnold Networks (KAN) is an emerging neural network architecture in machine learning. It has greatly interested the research community about whether KAN can be a promising alternative of the commonly used Multi-Layer Perceptions…

Machine Learning · Computer Science 2024-09-17 Haihong Guo , Fengxin Li , Jiao Li , Hongyan Liu