English
Related papers

Related papers: Kolmogorov-Arnold Transformer

200 papers

In this paper, we present an innovative federated learning (FL) approach that utilizes Kolmogorov-Arnold Networks (KANs) for classification tasks. By utilizing the adaptive activation capabilities of KANs in a federated framework, we aim to…

Machine Learning · Computer Science 2024-11-12 Engin Zeydan , Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Marius Caus , Abdullah Aydeger

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A…

Machine Learning · Statistics 2026-05-22 Roberto Cavoretto , Alessandra De Rossi , Adeeba Haider , Amir Noorizadegan

The Kolmogorov-Arnold representation theorem offers a theoretical alternative to Multi-Layer Perceptrons (MLPs) by placing learnable univariate functions on edges rather than nodes. While recent implementations such as Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-01-28 Oscar Eliasson

The present paper introduces concurrency-driven enhancements to the training algorithm for the Kolmogorov-Arnold networks (KANs) that is based on the Newton-Kaczmarz (NK) method. Prior research shows that KANs trained using the NK-based…

Machine Learning · Computer Science 2026-03-30 Andrew Polar , Michael Poluektov

Neural networks have emerged as powerful tools for modeling complex physical systems, yet balancing high accuracy with computational efficiency remains a critical challenge in their convergence behavior. In this work, we propose the Hybrid…

Machine Learning · Computer Science 2025-04-01 Zuyu Xu , Bin Lv

Continual learning requires models to train continuously across consecutive tasks without forgetting. Most existing methods utilize linear classifiers, which struggle to maintain a stable classification space while learning new tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yusong Hu , Zichen Liang , Fei Yang , Qibin Hou , Xialei Liu , Ming-Ming Cheng

This paper proposes an innovative framework for Unsupervised Image Dehazing via Kolmogorov-Arnold Transformation, termed UID-KAT. Image dehazing is recognized as a challenging and ill-posed vision task that requires complex transformations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Le-Anh Tran

In this work we propose CVKAN, a complex-valued Kolmogorov-Arnold Network (KAN), to join the intrinsic interpretability of KANs and the advantages of Complex-Valued Neural Networks (CVNNs). We show how to transfer a KAN and the necessary…

Machine Learning · Computer Science 2025-12-01 Matthias Wolff , Florian Eilers , Xiaoyi Jiang

Kolmogorov-Arnold Networks (KANs) offer a structured and interpretable framework for multivariate function approximation by composing univariate transformations through additive or multiplicative aggregation. This paper establishes…

Machine Learning · Computer Science 2025-12-05 Wei Liu , Eleni Chatzi , Zhilu Lai

Kolmogorov-Arnold Networks or KANs have shown the ability to outperform classical Deep Neural Networks, while using far fewer trainable parameters for regression problems on scientific domains. Even more powerful has been their…

Permutation equivariant neural networks employing parameter-sharing schemes have emerged as powerful models for leveraging a wide range of data symmetries, significantly enhancing the generalization and computational efficiency of the…

Machine Learning · Computer Science 2026-03-10 Ran Elbaz , Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Denial-of-Service (DoS) attacks pose a critical threat to Internet of Things (IoT) ecosystems, yet deploying effective intrusion detection on resource-constrained edge devices remains challenging. Kolmogorov-Arnold Networks (KANs) offer a…

Machine Learning · Computer Science 2026-01-14 Oleksandr Kuznetsov

Kolmogorov Arnold Networks (KANs) are neural architectures inspired by the Kolmogorov Arnold representation theorem that leverage B Spline parameterizations for flexible, locally adaptive function approximation. Although KANs can capture…

Machine Learning · Computer Science 2025-03-04 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Kolmogorov-Arnold Networks(KANs), as a theoretically efficient neural network architecture, have garnered attention for their potential in capturing complex patterns. However, their application in computer vision remains relatively…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yueyang Cang , Yu hang liu , Li Shi

Hyperspectral image classification is a crucial but challenging task due to the high dimensionality and complex spatial-spectral correlations inherent in hyperspectral data. This paper employs Wavelet-based Kolmogorov-Arnold Network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Seyd Teymoor Seydi , Zavareh Bozorgasl , Hao Chen

Kolmogorov-Arnold Network (KAN) is a network structure recently proposed by Liu et al. (2024) that offers improved interpretability and a more parsimonious design in many science-oriented tasks compared to multi-layer perceptrons. This work…

Machine Learning · Computer Science 2024-12-05 Xianyang Zhang , Huijuan Zhou

Kolmogorov-Arnold Networks represent a recent advancement in machine learning, with the potential to outperform traditional perceptron-based neural networks across various domains as well as provide more interpretability with the use of…

High Energy Physics - Phenomenology · Physics 2024-09-26 E. Abasov , P. Volkov , G. Vorotnikov , L. Dudko , A. Zaborenko , E. Iudin , A. Markina , M. Perfilov

Deep neural networks achieve state-of-the-art performance in estimating heterogeneous treatment effects, but their opacity limits trust and adoption in sensitive domains such as medicine, economics, and public policy. Building on…

Machine Learning · Statistics 2025-12-08 Alejandro Almodóvar , Patricia A. Apellániz , Santiago Zazo , Juan Parras

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-10-20 Sergey Pozdnyakov , Philippe Schwaller

Recent Transformer- and MLP-based models have demonstrated strong performance in long-term time series forecasting, yet Transformers remain limited by their quadratic complexity and permutation-equivariant attention, while MLPs exhibit…

Machine Learning · Computer Science 2026-03-12 Md Zahidul Hasan , A. Ben Hamza , Nizar Bouguila