English
Related papers

Related papers: KAN versus MLP on Irregular or Noisy Functions

200 papers

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Reinforcement learning (RL) has been increasingly applied to network control problems, such as load balancing. However, existing RL approaches often suffer from lack of interpretability and difficulty in extracting controller equations. In…

Machine Learning · Computer Science 2025-05-21 Kamal Singh , Sami Marouani , Ahmad Al Sheikh , Pham Tran Anh Quang , Amaury Habrard

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

Machine Learning · Computer Science 2025-06-24 Ali Kashefi , Tapan Mukerji

Neural networks have emerged as powerful tools for modeling complex physical systems, yet balancing high accuracy with computational efficiency remains a critical challenge in their convergence behavior. In this work, we propose the Hybrid…

Machine Learning · Computer Science 2025-04-01 Zuyu Xu , Bin Lv

Feature selection is a key step in many tabular prediction problems, where multiple candidate variables may be redundant, noisy, or weakly informative. We investigate feature selection based on Kolmogorov-Arnold Networks (KANs), which…

Machine Learning · Computer Science 2026-03-20 Ange-Clément Akazan , Verlon Roel Mbingui

Scientific discovery and dynamic characterization of the physical system play a critical role in understanding, learning, and modeling the physical phenomena and behaviors in various fields. Although theories and laws of many system…

Optics · Physics 2025-04-29 Xiaotian Jiang , Min Zhang , Xiao Luo , Zelai Yu , Yiming Meng , Danshi Wang

To address the issue of interpretability in multilayer perceptrons (MLPs), Kolmogorov-Arnold Networks (KANs) are introduced in 2024. However, optimizing KAN structures is labor-intensive, typically requiring manual intervention and…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Quan Long , Bin Wang , Bing Xue , Mengjie Zhang

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-10-20 Sergey Pozdnyakov , Philippe Schwaller

Kolmogorov-Arnold networks (KANs) offer a potent combination of accuracy and interpretability, thanks to their compositions of learnable univariate activation functions. However, the activations of well-fitting KANs tend to exhibit…

Machine Learning · Computer Science 2026-05-05 James Bagrow

In this paper, we introduce FC-KAN, a Kolmogorov-Arnold Network (KAN) that leverages combinations of popular mathematical functions such as B-splines, wavelets, and radial basis functions on low-dimensional data through element-wise…

Machine Learning · Computer Science 2026-03-17 Hoang-Thang Ta , Duy-Quy Thai , Abu Bakar Siddiqur Rahman , Grigori Sidorov , Alexander Gelbukh

Recent advancements in neural network design have given rise to the development of Kolmogorov-Arnold Networks (KANs), which enhance speed, interpretability, and precision. This paper presents the Fractional Kolmogorov-Arnold Network (fKAN),…

Machine Learning · Computer Science 2024-06-12 Alireza Afzal Aghaei

Multivariate time series forecasting is a crucial task that predicts the future states based on historical inputs. Related techniques have been developing in parallel with the machine learning community, from early statistical learning…

Machine Learning · Computer Science 2025-02-12 Xiao Han , Xinfeng Zhang , Yiling Wu , Zhenduo Zhang , Zhe Wu

Kolmogorov-Arnold Networks (KANs) uniquely combine high accuracy with interpretability, making them valuable for scientific modeling. However, it is unclear a priori how deep a network needs to be for any given task, and deeper KANs can be…

Machine Learning · Computer Science 2025-08-22 James Bagrow , Josh Bongard

Kolmogorov Arnold Networks (KANs) are neural architectures inspired by the Kolmogorov Arnold representation theorem that leverage B Spline parameterizations for flexible, locally adaptive function approximation. Although KANs can capture…

Machine Learning · Computer Science 2025-03-04 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Kolmogorov-Arnold Networks (KANs) have recently emerged as a compelling alternative to multilayer perceptrons, offering enhanced interpretability via functional decomposition. However, existing KAN architectures, including spline-,…

Machine Learning · Computer Science 2026-02-19 Sidharth S. Menon , Ameya D. Jagtap

In this paper, we described and developed a framework for Multilayer Perceptron (MLP) to work on low level image processing, where MLP will be used to perform image super-resolution. Meanwhile, MLP are trained with different types of images…

Computer Vision and Pattern Recognition · Computer Science 2012-12-24 Kah Keong Chua , Yong Haur Tay

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

Hardware Architecture · Computer Science 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

Machine Learning · Computer Science 2025-03-20 Rodion Novkin , Hussam Amrouch

We present a novel approach to predicting the pressure and flow rate of flexible electrohydrodynamic pumps using the Kolmogorov-Arnold Network. Inspired by the Kolmogorov-Arnold representation theorem, KAN replaces fixed activation…

Machine Learning · Computer Science 2024-12-31 Yanhong Peng , Yuxin Wang , Fangchao Hu , Miao He , Zebing Mao , Xia Huang , Jun Ding

Time series forecasting has long been a focus of research across diverse fields, including economics, energy, healthcare, and traffic management. Recent works have introduced innovative architectures for time series models, such as the…

Machine Learning · Computer Science 2025-03-28 Young-Chae Hong , Bei Xiao , Yangho Chen