English
Related papers

Related papers: KAC: Kolmogorov-Arnold Classifier for Continual Le…

200 papers

Continual learning (CL), the ability of a model to learn new tasks without forgetting previously acquired knowledge, remains a critical challenge in artificial intelligence, particularly for vision transformers (ViTs) utilizing Multilayer…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zahid Ullah , Jihie Kim

The emergence of Kolmogorov-Arnold Networks (KANs) has sparked significant interest and debate within the scientific community. This paper explores the application of KANs in the domain of computer vision (CV). We examine the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Ivan Drokin

Catastrophic forgetting is a longstanding challenge in continual learning, where models lose knowledge from earlier tasks when learning new ones. While various mitigation strategies have been proposed for Multi-Layer Perceptrons (MLPs),…

Machine Learning · Computer Science 2025-11-18 Mohammad Marufur Rahman , Guanchu Wang , Kaixiong Zhou , Minghan Chen , Fan Yang

Deeply stacked KANs are practically impossible due to high training difficulties and substantial memory requirements. Consequently, existing studies can only incorporate few KAN layers, hindering the comprehensive exploration of KANs. This…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Xingyu Qiu , Xinghua Ma , Dong Liang , Gongning Luo , Wei Wang , Kuanquan Wang , Shuo Li

This paper introduces the Hierarchical Kolmogorov-Arnold Network (HKAN), a novel network architecture that offers a competitive alternative to the recently proposed Kolmogorov-Arnold Network (KAN). Unlike KAN, which relies on…

Machine Learning · Computer Science 2026-01-21 Grzegorz Dudek , Tomasz Rodak

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

Machine Learning · Computer Science 2025-03-20 Rodion Novkin , Hussam Amrouch

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

Machine Learning · Computer Science 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Kolmogorov-Arnold Networks (KANs) have recently emerged as a promising alternative to traditional neural architectures, yet their application to speech processing remains under explored. This work presents the first investigation of KANs…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Eliana Pastor , Sabato Marco Siniscalchi , Elena Baralis

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

Machine Learning · Computer Science 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Deep learning neural networks architectures such Multi Layer Perceptrons (MLP) and Convolutional blocks still play a crucial role in nowadays research advancements. From a topological point of view, these architecture may be represented as…

Machine Learning · Computer Science 2025-07-29 Ugo Lomoio , Pierangelo Veltri , Pietro Hiram Guzzi

Kolmogorov-Arnold Networks (KANs), a novel type of neural network, have recently gained popularity and attention due to the ability to substitute multi-layer perceptions (MLPs) in artificial intelligence (AI) with higher accuracy and…

Inspired by the Kolmogorov-Arnold representation theorem, KANs offer a novel framework for function approximation by replacing traditional neural network weights with learnable univariate functions. This design demonstrates significant…

Machine Learning · Computer Science 2025-06-10 Zhangchi Zhao , Jun Shu , Deyu Meng , Zongben Xu

Feature selection is a key step in many tabular prediction problems, where multiple candidate variables may be redundant, noisy, or weakly informative. We investigate feature selection based on Kolmogorov-Arnold Networks (KANs), which…

Machine Learning · Computer Science 2026-03-20 Ange-Clément Akazan , Verlon Roel Mbingui

We introduce the Kolmogorov-Arnold Network for Dynamics (KANDy) as a zero-depth, wide neural architecture capable of discovering governing equations in chaotic and complex dynamical systems. Building on the foundation of Kolmogorov-Arnold…

Dynamical Systems · Mathematics 2026-03-26 Kevin Slote , Jeremie Fish , Erik Bollt

Kolmogorov-Arnold Networks (KANs) have garnered significant attention for their promise of improved parameter efficiency and explainability compared to traditional Deep Neural Networks (DNNs). KANs' key innovation lies in the use of…

Hardware Architecture · Computer Science 2025-12-02 Sohaib Errabii , Olivier Sentieys , Marcello Traiola

Kolmogorov-Arnold Neural Networks (KANs) have gained significant attention in the machine learning community. However, their implementation often suffers from poor training stability and heavy trainable parameter. Furthermore, there is…

Machine Learning · Computer Science 2025-01-17 Liangwewi Nathan Zheng , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A…

Machine Learning · Statistics 2026-05-22 Roberto Cavoretto , Alessandra De Rossi , Adeeba Haider , Amir Noorizadegan

Kolmogorov-Arnold Networks (KANs) are a recent neural network architecture offering an alternative to Multilayer Perceptrons (MLPs) with improved explainability and expressibility. However, KANs are significantly slower than MLPs due to the…

Machine Learning · Computer Science 2026-04-27 Eduardo Said Merin-Martinez , Andres Mendez-Vazquez , Eduardo Rodriguez-Tello

Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or…

Machine Learning · Computer Science 2025-01-24 Eleonora Poeta , Flavio Giobergia , Eliana Pastor , Tania Cerquitelli , Elena Baralis