English
Related papers

Related papers: Improving Memory Efficiency for Training KANs via …

200 papers

Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. However, transfer learning of KANs remains a relatively…

Machine Learning · Computer Science 2025-02-17 Yihang Gao , Michael K. Ng , Vincent Y. F. Tan

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Inspired by the Kolmogorov-Arnold superposition theorem, Kolmogorov-Arnold Networks (KANs) have recently emerged as an improved backbone for most deep learning frameworks, promising more adaptivity than their multilayer perceptron (MLP)…

Machine Learning · Computer Science 2025-08-07 Anastasis Kratsios , Bum Jun Kim , Takashi Furuya

In this paper, we introduce Wav-KAN, an innovative neural network architecture that leverages the Wavelet Kolmogorov-Arnold Networks (Wav-KAN) framework to enhance interpretability and performance. Traditional multilayer perceptrons (MLPs)…

Machine Learning · Computer Science 2024-05-28 Zavareh Bozorgasl , Hao Chen

Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ali Jamali , Swalpa Kumar Roy , Danfeng Hong , Bing Lu , Pedram Ghamisi

The need for scalable and expressive models in machine learning is paramount, particularly in applications requiring both structural depth and flexibility. Traditional deep learning methods, such as multilayer perceptrons (MLP), offer depth…

Machine Learning · Computer Science 2024-08-01 Shrenik Zinage , Sudeepta Mondal , Soumalya Sarkar

We propose a novel approach that enhances multivariate function approximation using learnable path signatures and Kolmogorov-Arnold networks (KANs). We enhance the learning capabilities of these networks by weighting the values obtained by…

Machine Learning · Computer Science 2024-12-10 Hugo Inzirillo , Remi Genet

The Kolmogorov-Arnold representation theorem offers a theoretical alternative to Multi-Layer Perceptrons (MLPs) by placing learnable univariate functions on edges rather than nodes. While recent implementations such as Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-01-28 Oscar Eliasson

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

Machine Learning · Computer Science 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Ali Kashefi

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Due to their effective performance, Convolutional Neural Network (CNN) and Vision Transformer (ViT) architectures have become the standard for solving computer vision tasks. Such architectures require large data sets and rely on convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jorge Luiz dos Santos Canuto , Linnyer Beatrys Ruiz Aylon , Rodrigo Clemente Thom de Souza

The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamental multivariate function. In this work, we investigate the…

Machine Learning · Computer Science 2024-07-31 Mohammed Ghaith Altarabichi

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

Machine Learning · Computer Science 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

Collaborative filtering (CF) remains essential in recommender systems, leveraging user--item interactions to provide personalized recommendations. Meanwhile, a number of CF techniques have evolved into sophisticated model architectures…

Information Retrieval · Computer Science 2024-09-12 Jin-Duk Park , Kyung-Min Kim , Won-Yong Shin

To address the challenge of tractability for optimizing mathematical models in science and engineering, surrogate models are often employed. Recently, a new class of machine learning models named Kolmogorov Arnold Networks (KANs) have been…

Optimization and Control · Mathematics 2025-03-05 Tanuj Karia , Giacomo Lastrucci , Artur M. Schweidtmann

Symbolic neural networks, such as Kolmogorov-Arnold Networks (KAN), offer a promising approach for integrating prior knowledge with data-driven methods, making them valuable for addressing inverse problems in scientific and engineering…

Machine Learning · Computer Science 2024-11-05 Xia Chen , Guoquan Lv , Xinwei Zhuang , Carlos Duarte , Stefano Schiavon , Philipp Geyer

This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to…

Machine Learning · Computer Science 2024-09-13 Sheng Shen , Rabih Younes

Recent advancements in deep learning for image classification predominantly rely on convolutional neural networks (CNNs) or Transformer-based architectures. However, these models face notable challenges in medical imaging, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao