English
Related papers

Related papers: KANtize: Exploring Low-bit Quantization of Kolmogo…

200 papers

Kolmogorov-Arnold Networks (KANs) have recently shown promise for solving partial differential equations (PDEs). Yet their original formulation is computationally and memory intensive, motivating the introduction of Chebyshev Type-I-based…

Machine Learning · Computer Science 2026-01-19 Hangwei Zhang , Zhimu Huang , Yan Wang

Recently, multi-layer perceptrons (MLPs) widely used in modern AI applications suffer from limited real-time performance due to intensive memory access overhead. Kolmogorov--Arnold Networks (KANs) have attracted increasing attention as an…

Hardware Architecture · Computer Science 2026-03-03 Wenhui Ou , Zhuoyu Wu , Yipu Zhang , Zheng Wang , C. Patrick Yue

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they…

Numerical Analysis · Mathematics 2025-01-22 Zhiwei Gao , George Em Karniadakis

A new Kolmogorov-Arnold network (KAN) is proposed to approximate potentially irregular functions in high dimensions. We provide error bounds for this approximation, assuming that the Kolmogorov-Arnold expansion functions are sufficiently…

Machine Learning · Computer Science 2026-05-05 Xavier Warin

In recent years, Graph Neural Networks (GNNs) have become the de facto tool for learning node and graph representations. Most GNNs typically consist of a sequence of neighborhood aggregation (a.k.a., message-passing) layers, within which…

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

We introduce cumulative polynomial Kolmogorov-Arnold networks (CP-KAN), a neural architecture combining Chebyshev polynomial basis functions and quadratic unconstrained binary optimization (QUBO). Our primary contribution involves…

Machine Learning · Computer Science 2025-05-22 Mathew Vanherreweghe , Lirandë Pira , Patrick Rebentrost

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multi-Layer Perceptrons (MLPs), offering enhanced interpretability and a solid mathematical foundation. However, their parameter efficiency remains a…

Machine Learning · Computer Science 2025-10-09 Di Zhang

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-10-20 Sergey Pozdnyakov , Philippe Schwaller

We present a novel approach for verifying properties of Kolmogorov-Arnold Networks (KANs), a class of neural networks characterized by nonlinear, univariate activation functions typically implemented as piecewise polynomial splines or…

Machine Learning · Computer Science 2026-02-09 Noah Schwartz , Chandra Kanth Nagesh , Sriram Sankaranarayanan , Ramneet Kaur , Tuhin Sahai , Susmit Jha

Physics-Informed Neural Networks (PINNs) have emerged as a powerful mesh-free framework for solving ordinary and partial differential equations by embedding the governing physical laws directly into the loss function. However, their…

Physics-Informed Neural Networks (PINNs) have emerged as a promising method for solving partial differential equations (PDEs) in scientific computing. While PINNs typically use multilayer perceptrons (MLPs) as their underlying architecture,…

Machine Learning · Computer Science 2024-11-12 Bruno Jacob , Amanda A. Howard , Panos Stinis

U-Net has become a cornerstone in various visual applications such as image segmentation and diffusion probability models. While numerous innovative designs and improvements have been introduced by incorporating transformers or MLPs, the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-23 Chenxin Li , Xinyu Liu , Wuyang Li , Cheng Wang , Hengyu Liu , Yifan Liu , Zhen Chen , Yixuan Yuan

Synthetic Aperture Radar (SAR) image recognition is vital for disaster monitoring, military reconnaissance, and ocean observation. However, large SAR image sizes hinder deep learning deployment on resource-constrained edge devices, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Pan Yi , Weijie Li , Xiaodong Chen , Jiehua Zhang , Li Liu , Yongxiang Liu

The growing need for accurate and efficient 3D identification of tumors, particularly in liver segmentation, has spurred considerable research into deep learning models. While many existing architectures offer strong performance, they often…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Bhavesh Gyanchandani , Aditya Oza , Abhinav Roy

The need for scalable and expressive models in machine learning is paramount, particularly in applications requiring both structural depth and flexibility. Traditional deep learning methods, such as multilayer perceptrons (MLP), offer depth…

Machine Learning · Computer Science 2024-08-01 Shrenik Zinage , Sudeepta Mondal , Soumalya Sarkar

Tabular data analysis presents unique challenges that arise from heterogeneous feature types, missing values, and complex feature interactions. While traditional machine learning methods like gradient boosting often outperform deep…

Machine Learning · Computer Science 2025-12-10 Ali Eslamian , Alireza Afzal Aghaei , Qiang Cheng

In the realm of intelligent education, cognitive diagnosis plays a crucial role in subsequent recommendation tasks attributed to the revealed students' proficiency in knowledge concepts. Although neural network-based neural cognitive…

Machine Learning · Computer Science 2024-05-24 Shangshang Yang , Linrui Qin , Xiaoshan Yu

Kolmogorov-Arnold Networks have recently been introduced as a flexible alternative to multi-layer Perceptron architectures. In this paper, we examine the training dynamics of different KAN architectures and compare them with corresponding…

Machine Learning · Computer Science 2024-11-11 Shairoz Sohail

Hyperspectral image classification is a crucial but challenging task due to the high dimensionality and complex spatial-spectral correlations inherent in hyperspectral data. This paper employs Wavelet-based Kolmogorov-Arnold Network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Seyd Teymoor Seydi , Zavareh Bozorgasl , Hao Chen