English
Related papers

Related papers: Multi-Resolution Training-Enhanced Kolmogorov-Arno…

200 papers

Deep learning has long been dominated by multi-layer perceptrons (MLPs), which have demonstrated superiority over other optimizable models in various domains. Recently, a new alternative to MLPs has emerged - Kolmogorov-Arnold Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alessandro Cacciatore , Valerio Morelli , Federica Paganica , Emanuele Frontoni , Lucia Migliorelli , Daniele Berardini

In traditional neural network architectures, a multilayer perceptron (MLP) is typically employed as a classification block following the feature extraction stage. However, the Kolmogorov-Arnold Network (KAN) presents a promising alternative…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Valeriy Lobanov , Nikita Firsov , Evgeny Myasnikov , Roman Khabibullin , Artem Nikonorov

High-dimensional linear mappings, or linear layers, dominate both the parameter count and the computational cost of most modern deep-learning models. We introduce a general-purpose drop-in replacement, lookup multivariate Kolmogorov-Arnold…

Machine Learning · Computer Science 2025-10-20 Sergey Pozdnyakov , Philippe Schwaller

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Minjong Cheon

Finding solutions to partial differential equations (PDEs) is an important and essential component in many scientific and engineering discoveries. One of the common approaches empowered by deep learning is Physics-informed Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-10-01 Chi Chiu So , Siu Pang Yung

Interpreting complex datasets remains a major challenge for scientists, particularly due to high dimensionality and collinearity among variables. We introduce a novel application of Kolmogorov-Arnold Networks (KANs) to enhance…

Machine Learning · Computer Science 2025-12-19 Luis A. De la Fuente , Hernan A. Moreno , Laura V. Alvarez , Hoshin V. Gupta

We introduce evolutionary Kolmogorov-Arnold Networks (EvoKAN), a novel framework for solving complex partial differential equations (PDEs). EvoKAN builds on Kolmogorov-Arnold Networks (KANs), where activation functions are spline based and…

Numerical Analysis · Mathematics 2025-03-04 Guang Lin , Changhong Mou , Jiahao Zhang

Symbolic neural networks, such as Kolmogorov-Arnold Networks (KAN), offer a promising approach for integrating prior knowledge with data-driven methods, making them valuable for addressing inverse problems in scientific and engineering…

Machine Learning · Computer Science 2024-11-05 Xia Chen , Guoquan Lv , Xinwei Zhuang , Carlos Duarte , Stefano Schiavon , Philipp Geyer

Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distributions, and…

Machine Learning · Computer Science 2026-02-27 Mingming Zhang , Pengfei Shi , Zhiqing Xiao , Feng Zhao , Guandong Sun , Yulin Kang , Ruizhe Gao , Ningtao Wang , Xing Fu , Weiqiang Wang , Junbo Zhao

Kolmogorov-Arnold Networks (KANs) have garnered attention for replacing fixed activation functions with learnable univariate functions, but they exhibit practical limitations, including high computational costs and performance deficits in…

Machine Learning · Computer Science 2025-07-08 Hanseon Joo , Hayoung Choi , Ook Lee , Minjong Cheon

The research undertakes a comprehensive comparative analysis of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptrons (MLP), highlighting their effectiveness in solving essential computational challenges like nonlinear function…

Machine Learning · Computer Science 2026-01-16 Aradhya Gaonkar , Nihal Jain , Vignesh Chougule , Nikhil Deshpande , Sneha Varur , Channabasappa Muttal

Multi-layer perceptrons (MLP's) have been extensively utilized in discovering Deep Koopman operators for linearizing nonlinear dynamics. With the emergence of Kolmogorov-Arnold Networks (KANs) as a more efficient and accurate alternative to…

Machine Learning · Computer Science 2024-08-13 George Nehma , Madhur Tiwari

We introduce cumulative polynomial Kolmogorov-Arnold networks (CP-KAN), a neural architecture combining Chebyshev polynomial basis functions and quadratic unconstrained binary optimization (QUBO). Our primary contribution involves…

Machine Learning · Computer Science 2025-05-22 Mathew Vanherreweghe , Lirandë Pira , Patrick Rebentrost

Recent work has established an alternative to traditional multi-layer perceptron neural networks in the form of Kolmogorov-Arnold Networks (KAN). The general KAN framework uses learnable activation functions on the edges of the…

Machine Learning · Computer Science 2025-01-28 Eric A. F. Reinhardt , P. R. Dinesh , Sergei Gleyzer

The growing need for accurate and efficient 3D identification of tumors, particularly in liver segmentation, has spurred considerable research into deep learning models. While many existing architectures offer strong performance, they often…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Bhavesh Gyanchandani , Aditya Oza , Abhinav Roy

This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to…

Machine Learning · Computer Science 2024-09-13 Sheng Shen , Rabih Younes

Kolmogorov-Arnold Network (KAN) has attracted growing interest for its strong function approximation capability. In our previous work, KAN and its variants were explored in score regression for blind image quality assessment (BIQA).…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Ze Chen , Shaode Yu

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

Machine Learning · Computer Science 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Kolmogorov-Arnold Networks (KANs) are a class of neural networks that have received increased attention in recent literature. In contrast to MLPs, KANs leverage parameterized, trainable activation functions and offer several benefits…

Machine Learning · Computer Science 2025-11-14 Jamison Moody , James Usevitch