中文
相关论文

相关论文: Improving Memory Efficiency for Training KANs via …

200 篇论文

Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. However, transfer learning of KANs remains a relatively…

机器学习 · 计算机科学 2025-02-17 Yihang Gao , Michael K. Ng , Vincent Y. F. Tan

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

硬件体系结构 · 计算机科学 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Inspired by the Kolmogorov-Arnold superposition theorem, Kolmogorov-Arnold Networks (KANs) have recently emerged as an improved backbone for most deep learning frameworks, promising more adaptivity than their multilayer perceptron (MLP)…

机器学习 · 计算机科学 2025-08-07 Anastasis Kratsios , Bum Jun Kim , Takashi Furuya

In this paper, we introduce Wav-KAN, an innovative neural network architecture that leverages the Wavelet Kolmogorov-Arnold Networks (Wav-KAN) framework to enhance interpretability and performance. Traditional multilayer perceptrons (MLPs)…

机器学习 · 计算机科学 2024-05-28 Zavareh Bozorgasl , Hao Chen

Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Ali Jamali , Swalpa Kumar Roy , Danfeng Hong , Bing Lu , Pedram Ghamisi

The need for scalable and expressive models in machine learning is paramount, particularly in applications requiring both structural depth and flexibility. Traditional deep learning methods, such as multilayer perceptrons (MLP), offer depth…

机器学习 · 计算机科学 2024-08-01 Shrenik Zinage , Sudeepta Mondal , Soumalya Sarkar

We propose a novel approach that enhances multivariate function approximation using learnable path signatures and Kolmogorov-Arnold networks (KANs). We enhance the learning capabilities of these networks by weighting the values obtained by…

机器学习 · 计算机科学 2024-12-10 Hugo Inzirillo , Remi Genet

The Kolmogorov-Arnold representation theorem offers a theoretical alternative to Multi-Layer Perceptrons (MLPs) by placing learnable univariate functions on edges rather than nodes. While recent implementations such as Kolmogorov-Arnold…

机器学习 · 计算机科学 2026-01-28 Oscar Eliasson

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

机器学习 · 计算机科学 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Ali Kashefi

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

机器学习 · 计算机科学 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Due to their effective performance, Convolutional Neural Network (CNN) and Vision Transformer (ViT) architectures have become the standard for solving computer vision tasks. Such architectures require large data sets and rely on convolution…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Jorge Luiz dos Santos Canuto , Linnyer Beatrys Ruiz Aylon , Rodrigo Clemente Thom de Souza

The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamental multivariate function. In this work, we investigate the…

机器学习 · 计算机科学 2024-07-31 Mohammed Ghaith Altarabichi

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

机器学习 · 计算机科学 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

Collaborative filtering (CF) remains essential in recommender systems, leveraging user--item interactions to provide personalized recommendations. Meanwhile, a number of CF techniques have evolved into sophisticated model architectures…

信息检索 · 计算机科学 2024-09-12 Jin-Duk Park , Kyung-Min Kim , Won-Yong Shin

To address the challenge of tractability for optimizing mathematical models in science and engineering, surrogate models are often employed. Recently, a new class of machine learning models named Kolmogorov Arnold Networks (KANs) have been…

最优化与控制 · 数学 2025-03-05 Tanuj Karia , Giacomo Lastrucci , Artur M. Schweidtmann

Symbolic neural networks, such as Kolmogorov-Arnold Networks (KAN), offer a promising approach for integrating prior knowledge with data-driven methods, making them valuable for addressing inverse problems in scientific and engineering…

机器学习 · 计算机科学 2024-11-05 Xia Chen , Guoquan Lv , Xinwei Zhuang , Carlos Duarte , Stefano Schiavon , Philipp Geyer

This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to…

机器学习 · 计算机科学 2024-09-13 Sheng Shen , Rabih Younes

Recent advancements in deep learning for image classification predominantly rely on convolutional neural networks (CNNs) or Transformer-based architectures. However, these models face notable challenges in medical imaging, particularly in…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold networks (KANs) represent data features by learning the activation functions and demonstrate superior accuracy with fewer parameters, FLOPs, GPU memory usage (Memory), shorter training time (TraT), and testing time (TesT)…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Yanheng Wang , Xiaohan Yu , Yongsheng Gao , Jianjun Sha , Jian Wang , Shiyong Yan , Kai Qin , Yonggang Zhang , Lianru Gao