English
Related papers

Related papers: Improving Memory Efficiency for Training KANs via …

200 papers

In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Minjong Cheon

Permutation equivariant neural networks employing parameter-sharing schemes have emerged as powerful models for leveraging a wide range of data symmetries, significantly enhancing the generalization and computational efficiency of the…

Machine Learning · Computer Science 2026-03-10 Ran Elbaz , Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Kolmogorov-Arnold Networks (KANs) offer a structured and interpretable framework for multivariate function approximation by composing univariate transformations through additive or multiplicative aggregation. This paper establishes…

Machine Learning · Computer Science 2025-12-05 Wei Liu , Eleni Chatzi , Zhilu Lai

Kolmogorov-Arnold Networks (KANs) have been recently proposed as a machine learning framework that is more interpretable and controllable than the multi-layer perceptron. Various network architectures have been proposed within the KAN…

Machine Learning · Computer Science 2025-02-21 Tatiana Boura , Stasinos Konstantopoulos

Reinforcement learning (RL) has been increasingly applied to network control problems, such as load balancing. However, existing RL approaches often suffer from lack of interpretability and difficulty in extracting controller equations. In…

Machine Learning · Computer Science 2025-05-21 Kamal Singh , Sami Marouani , Ahmad Al Sheikh , Pham Tran Anh Quang , Amaury Habrard

Kolmogorov Arnold Networks (KANs), built upon the Kolmogorov Arnold representation theorem (KAR), have demonstrated promising capabilities in expressing complex functions with fewer neurons. This is achieved by implementing learnable…

Based on the Kolmogorov-Arnold Network (KAN), we present a novel emulator of the global 21 cm cosmology signal, $\texttt{21cmKAN}$, that provides extremely fast training speed while achieving nearly equivalent accuracy to the most accurate…

Cosmology and Nongalactic Astrophysics · Physics 2025-08-19 J. Dorigo Jones , B. Reyes , D. Rapetti , Shah Mohammad Bahauddin , J. O. Burns , D. W. Barker

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Kolmogorov-Arnold networks (KANs) offer a potent combination of accuracy and interpretability, thanks to their compositions of learnable univariate activation functions. However, the activations of well-fitting KANs tend to exhibit…

Machine Learning · Computer Science 2026-05-05 James Bagrow

Multi-Layer Perceptrons (MLPs) have become one of the fundamental architectural component in point cloud analysis due to its effective feature learning mechanism. However, when processing complex geometric structures in point clouds, MLPs'…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yan Shi , Qingdong He , Yijun Liu , Xiaoyu Liu , Jingyong Su

This paper introduces the Hierarchical Kolmogorov-Arnold Network (HKAN), a novel network architecture that offers a competitive alternative to the recently proposed Kolmogorov-Arnold Network (KAN). Unlike KAN, which relies on…

Machine Learning · Computer Science 2026-01-21 Grzegorz Dudek , Tomasz Rodak

Physics-Informed Neural Networks (PINNs) have emerged as a powerful mesh-free framework for solving ordinary and partial differential equations by embedding the governing physical laws directly into the loss function. However, their…

Kolmogorov-Arnold Networks (KANs) have seen great success in scientific domains thanks to spline activation functions, becoming an alternative to Multi-Layer Perceptrons (MLPs). However, spline functions may not respect symmetry in tasks,…

Machine Learning · Computer Science 2025-08-18 Lexiang Hu , Yisen Wang , Zhouchen Lin

Building models of natural language processing (NLP) is challenging in low-resource scenarios where only limited data are available. Optimization-based meta-learning algorithms achieve promising results in low-resource scenarios by adapting…

Computation and Language · Computer Science 2022-07-15 Yingxiu Zhao , Zhiliang Tian , Huaxiu Yao , Yinhe Zheng , Dongkyu Lee , Yiping Song , Jian Sun , Nevin L. Zhang

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

This paper proposes an innovative framework for Unsupervised Image Dehazing via Kolmogorov-Arnold Transformation, termed UID-KAT. Image dehazing is recognized as a challenging and ill-posed vision task that requires complex transformations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Le-Anh Tran

Quantum architecture Search (QAS) is a promising direction for optimization and automated design of quantum circuits towards quantum advantage. Recent techniques in QAS emphasize Multi-Layer Perceptron (MLP)-based deep Q-networks. However,…

Quantum Physics · Physics 2024-12-13 Akash Kundu , Aritra Sarkar , Abhishek Sadhu

Kolmogorov-Arnold Networks (KANs) have garnered significant attention for their promise of improved parameter efficiency and explainability compared to traditional Deep Neural Networks (DNNs). KANs' key innovation lies in the use of…

Hardware Architecture · Computer Science 2025-12-02 Sohaib Errabii , Olivier Sentieys , Marcello Traiola

Vision Transformers (ViTs) have significantly advanced image classification by applying self-attention on patch embeddings. However, the standard MLP blocks in each Transformer layer may not capture complex nonlinear dependencies optimally.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shreyas S , Akshath M

Kolmogorov Arnold Networks (KANs) represent a new class of neural architectures that replace conventional linear transformations and node-based nonlinearities with spline-based function approximations distributed along network edges.…

Machine Learning · Computer Science 2026-01-30 Kazi Ahmed Asif Fuad , Lizhong Chen