English
Related papers

Related papers: Softly Symbolifying Kolmogorov-Arnold Networks

200 papers

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

Hardware Architecture · Computer Science 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Transformers stand as the cornerstone of mordern deep learning. Traditionally, these models rely on multi-layer perceptron (MLP) layers to mix the information between channels. In this paper, we introduce the Kolmogorov-Arnold Transformer…

Machine Learning · Computer Science 2024-09-18 Xingyi Yang , Xinchao Wang

To address the issue of interpretability in multilayer perceptrons (MLPs), Kolmogorov-Arnold Networks (KANs) are introduced in 2024. However, optimizing KAN structures is labor-intensive, typically requiring manual intervention and…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Quan Long , Bin Wang , Bing Xue , Mengjie Zhang

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

Machine Learning · Computer Science 2025-03-20 Rodion Novkin , Hussam Amrouch

Kolmogorov-Arnold Networks (KANs) are emerging as a powerful framework for interpretable and efficient system identification in dynamic systems. By leveraging the Kolmogorov-Arnold representation theorem, KANs enable function approximation…

Machine Learning · Computer Science 2025-06-13 Nart Gashi , Panagiotis Kakosimos , George Papafotiou

Time series classification is a relevant step supporting decision-making processes in various domains, and deep neural models have shown promising performance in this respect. Despite significant advancements in deep learning, the…

Machine Learning · Computer Science 2025-11-04 Irina Barašin , Blaž Bertalanič , Mihael Mohorčič , Carolina Fortuna

Kolmogorov-Arnold Networks (KANs) offer a structured and interpretable framework for multivariate function approximation by composing univariate transformations through additive or multiplicative aggregation. This paper establishes…

Machine Learning · Computer Science 2025-12-05 Wei Liu , Eleni Chatzi , Zhilu Lai

This study explores the application of Kolmogorov-Arnold Networks (KANs) in predicting nuclear binding energies, leveraging their ability to decompose complex multi-parameter systems into simpler univariate functions. By utilizing data from…

Nuclear Theory · Physics 2025-02-10 Hao Liu , Jin Lei , Zhongzhou Ren

We introduce Graph Kolmogorov-Arnold Networks (GKAN), an innovative neural network architecture that extends the principles of the recently proposed Kolmogorov-Arnold Networks (KAN) to graph-structured data. By adopting the unique…

Machine Learning · Computer Science 2024-06-11 Mehrdad Kiamari , Mohammad Kiamari , Bhaskar Krishnamachari

This paper tests whether Kolmogorov--Arnold Networks (KAN 2.0) are genuinely more noise-robust than Multi-Layer Perceptrons (MLP) and XGBoost for stellar classification (star/galaxy/quasar, 100,000 SDSS DR17 objects). A naive comparison…

Instrumentation and Methods for Astrophysics · Physics 2026-05-29 Kristian Sestak

Inspired by the Kolmogorov-Arnold representation theorem and Kurkova's principle of using approximate representations, we propose the Kurkova-Kolmogorov-Arnold Network (KKAN), a new two-block architecture that combines robust multi-layer…

Machine Learning · Computer Science 2024-12-24 Juan Diego Toscano , Li-Lian Wang , George Em Karniadakis

Despite their immense success, deep convolutional neural networks (CNNs) can be difficult to optimize and costly to train due to hundreds of layers within the network depth. Conventional convolutional operations are fundamentally limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ray Congrui Yu , Sherry Wu , Jiang Gui

Multi-Layer Perceptrons (MLPs) rely on pre-defined, fixed activation functions, imposing a static inductive bias that forces the network to approximate complex topologies solely through increased depth and width. Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2026-03-10 Andrés Ortiz , Nicolás J. Gallego-Molina , Carmen Jiménez-Mesa , Juan M. Górriz , Javier Ramírez

This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation…

Signal Processing · Electrical Eng. & Systems 2025-10-28 Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Màrius Caus

Recently, Kolmogorov-Arnold Networks (KANs) have been proposed as an alternative to multilayer perceptrons, suggesting advantages in performance and interpretability. We study a typical binary event classification task in high-energy…

High Energy Physics - Phenomenology · Physics 2025-05-27 Johannes Erdmann , Florian Mausolf , Jan Lukas Späh

The Convolutional Neural Networks (CNNs) have been the dominant and effective approach for general computer vision tasks. Recently, Kolmogorov-Arnold neural networks (KANs), based on the Kolmogorov-Arnold representation theorem, have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhaoxiang Liu , Zhicheng Ma , Kaikai Zhao , Kai Wang , Shiguo Lian

In the realm of intelligent education, cognitive diagnosis plays a crucial role in subsequent recommendation tasks attributed to the revealed students' proficiency in knowledge concepts. Although neural network-based neural cognitive…

Machine Learning · Computer Science 2024-05-24 Shangshang Yang , Linrui Qin , Xiaoshan Yu

Unmanned aerial vehicle (UAV) communications demand accurate yet interpretable air-to-ground (A2G) channel models that can adapt to nonstationary propagation environments. While deterministic models offer interpretability and deep learning…

Machine Learning · Computer Science 2026-01-06 Kürşat Tekbıyık , Güneş Karabulut Kurt , Antoine Lesage-Landry

The Kolmogorov-Arnold representation theorem offers a theoretical alternative to Multi-Layer Perceptrons (MLPs) by placing learnable univariate functions on edges rather than nodes. While recent implementations such as Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-01-28 Oscar Eliasson

Kolmogorov-Arnold networks (KANs) as an alternative to multi-layer perceptrons (MLPs) are a recent development demonstrating strong potential for data-driven modeling. This work applies KANs as the backbone of a neural ordinary differential…

Machine Learning · Computer Science 2024-09-23 Benjamin C. Koenig , Suyong Kim , Sili Deng