English
Related papers

Related papers: MLP-KAN: Unifying Deep Representation and Function…

200 papers

U-Net has become a cornerstone in various visual applications such as image segmentation and diffusion probability models. While numerous innovative designs and improvements have been introduced by incorporating transformers or MLPs, the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-23 Chenxin Li , Xinyu Liu , Wuyang Li , Cheng Wang , Hengyu Liu , Yifan Liu , Zhen Chen , Yixuan Yuan

The Convolutional Neural Networks (CNNs) have been the dominant and effective approach for general computer vision tasks. Recently, Kolmogorov-Arnold neural networks (KANs), based on the Kolmogorov-Arnold representation theorem, have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhaoxiang Liu , Zhicheng Ma , Kaikai Zhao , Kai Wang , Shiguo Lian

Kolmogorov-Arnold Networks (KAN) has recently attracted significant attention as a promising alternative to traditional Multi-Layer Perceptrons (MLP). Despite their theoretical appeal, KAN require validation on large-scale benchmark…

Machine Learning · Computer Science 2024-09-12 Chang Dong , Liangwei Zheng , Weitong Chen

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

Machine Learning · Computer Science 2024-09-04 Victor Augusto Kich , Jair Augusto Bottega , Raul Steinmetz , Ricardo Bedin Grando , Ayano Yorozu , Akihisa Ohya

Kolmogorov-Arnold Networks (KAN) are a new class of neural network architecture representing a promising alternative to the Multilayer Perceptron (MLP), demonstrating improved expressiveness and interpretability. However, KANs suffer from…

Machine Learning · Computer Science 2025-03-04 Cale Coffman , Lizhong Chen

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-10-20 Sergey Pozdnyakov , Philippe Schwaller

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

Recent advancements in deep learning for image classification predominantly rely on convolutional neural networks (CNNs) or Transformer-based architectures. However, these models face notable challenges in medical imaging, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Neural networks have emerged as powerful tools for modeling complex physical systems, yet balancing high accuracy with computational efficiency remains a critical challenge in their convergence behavior. In this work, we propose the Hybrid…

Machine Learning · Computer Science 2025-04-01 Zuyu Xu , Bin Lv

Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ali Jamali , Swalpa Kumar Roy , Danfeng Hong , Bing Lu , Pedram Ghamisi

Algorithmic speedup of training common neural architectures is made difficult by the lack of structure guaranteed by the function compositions inherent to such networks. In contrast to multilayer perceptrons (MLPs), Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-03-06 Ben S. Southworth , Jonas A. Actor , Graham Harper , Eric C. Cyr

Physics-Informed Neural Networks (PINNs) have emerged as a powerful mesh-free framework for solving ordinary and partial differential equations by embedding the governing physical laws directly into the loss function. However, their…

Kolmogorov-Arnold Networks (KANs) have gained significant attention as an alternative to traditional multilayer perceptrons, with proponents claiming superior interpretability and performance through learnable univariate activation…

Machine Learning · Computer Science 2025-09-16 Yuntian Hou , Tianrui Ji , Di Zhang , Angelos Stefanidis

In this paper, we introduce Wav-KAN, an innovative neural network architecture that leverages the Wavelet Kolmogorov-Arnold Networks (Wav-KAN) framework to enhance interpretability and performance. Traditional multilayer perceptrons (MLPs)…

Machine Learning · Computer Science 2024-05-28 Zavareh Bozorgasl , Hao Chen

The ``black-box'' nature of deep learning models presents a significant barrier to their adoption for scientific discovery, where interpretability is paramount. This challenge is especially pronounced in discovering the governing equations…

Machine Learning · Computer Science 2025-08-26 Riccardo Cappi , Paolo Frazzetto , Nicolò Navarin , Alessandro Sperduti

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multi-Layer Perceptrons (MLPs), offering enhanced interpretability and a solid mathematical foundation. However, their parameter efficiency remains a…

Machine Learning · Computer Science 2025-10-09 Di Zhang

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

Machine Learning · Computer Science 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

Federated Learning (FL) enables model training across decentralized devices without sharing raw data, thereby preserving privacy in sensitive domains like healthcare. In this paper, we evaluate Kolmogorov-Arnold Networks (KAN) architectures…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-layer Perceptrons (MLPs) due to their superior function-fitting abilities in data-driven modeling. In this paper, we propose a novel framework, DAE-KAN, for…

Machine Learning · Computer Science 2025-04-24 Kai Luo , Juan Tang , Mingchao Cai , Xiaoqing Zeng , Manqi Xie , Ming Yan