English
Related papers

Related papers: Improving Memory Efficiency for Training KANs via …

200 papers

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

Kolmogorov-Arnold Networks (KANs) replace scalar weights with per-edge vectors of basis coefficients, thereby increasing expressivity and accuracy while also resulting in a multiplicative increase in parameters and memory. We propose…

Machine Learning · Computer Science 2026-02-10 Matthew Raffel , Adwaith Renjith , Lizhong Chen

Deep learning has long been dominated by multi-layer perceptrons (MLPs), which have demonstrated superiority over other optimizable models in various domains. Recently, a new alternative to MLPs has emerged - Kolmogorov-Arnold Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alessandro Cacciatore , Valerio Morelli , Federica Paganica , Emanuele Frontoni , Lucia Migliorelli , Daniele Berardini

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

Machine Learning · Computer Science 2024-09-04 Victor Augusto Kich , Jair Augusto Bottega , Raul Steinmetz , Ricardo Bedin Grando , Ayano Yorozu , Akihisa Ohya

The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold…

Machine Learning · Computer Science 2024-12-19 Ruichen Qiu , Yibo Miao , Shiwen Wang , Lijia Yu , Yifan Zhu , Xiao-Shan Gao

The recently proposed Kolmogorov-Arnold network (KAN) is a promising alternative to multi-layer perceptrons (MLPs) for data-driven modeling. While original KAN layers were only capable of representing the addition operator, the…

Machine Learning · Computer Science 2025-07-28 Benjamin C. Koenig , Suyong Kim , Sili Deng

The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to…

Computational Physics · Physics 2024-09-06 Rui Wang , Hongyu Yu , Yang Zhong , Hongjun Xiang

Kolmogorov-Arnold Networks (KAN) \cite{liu2024kan} were very recently proposed as a potential alternative to the prevalent architectural backbone of many deep learning models, the multi-layer perceptron (MLP). KANs have seen success in…

Machine Learning · Computer Science 2025-02-10 Yixuan Wang , Jonathan W. Siegel , Ziming Liu , Thomas Y. Hou

Kolmogorov-Arnold Networks (KAN) is an emerging neural network architecture in machine learning. It has greatly interested the research community about whether KAN can be a promising alternative of the commonly used Multi-Layer Perceptions…

Machine Learning · Computer Science 2024-09-17 Haihong Guo , Fengxin Li , Jiao Li , Hongyan Liu

Multilayer Perceptrons (MLPs) have long been a cornerstone in deep learning, known for their capacity to model complex relationships. Recently, Kolmogorov-Arnold Networks (KANs) have emerged as a compelling alternative, utilizing highly…

Machine Learning · Computer Science 2024-09-17 Farhad Pourkamali-Anaraki

This paper presents an experimental study of Kolmogorov-Arnold Networks (KANs) applied to computer vision tasks, particularly image classification. KANs introduce learnable activation functions on edges, offering flexible non-linear…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Karthik Mohan , Hanxiao Wang , Xiatian Zhu

In the realm of intelligent education, cognitive diagnosis plays a crucial role in subsequent recommendation tasks attributed to the revealed students' proficiency in knowledge concepts. Although neural network-based neural cognitive…

Machine Learning · Computer Science 2024-05-24 Shangshang Yang , Linrui Qin , Xiaoshan Yu

The field of scientific machine learning, which originally utilized multilayer perceptrons (MLPs), is increasingly adopting Kolmogorov-Arnold Networks (KANs) for data encoding. This shift is driven by the limitations of MLPs, including poor…

Machine Learning · Computer Science 2025-11-04 Salah A. Faroughi , Farinaz Mostajeran , Amin Hamed Mashhadzadeh , Shirko Faroughi

This systematic review explores the theoretical foundations, evolution, applications, and future potential of Kolmogorov-Arnold Networks (KAN), a neural network model inspired by the Kolmogorov-Arnold representation theorem. KANs…

Machine Learning · Computer Science 2025-06-09 Shriyank Somvanshi , Syed Aaqib Javed , Md Monzurul Islam , Diwas Pandit , Subasish Das

Kolmogorov-Arnold Networks (KANs) have gained significant attention as an alternative to traditional multilayer perceptrons, with proponents claiming superior interpretability and performance through learnable univariate activation…

Machine Learning · Computer Science 2025-09-16 Yuntian Hou , Tianrui Ji , Di Zhang , Angelos Stefanidis

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation…

Signal Processing · Electrical Eng. & Systems 2025-10-28 Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Màrius Caus

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful alternative to traditional multilayer perceptrons. However, their reliance on predefined, bounded grids restricts their ability to approximate functions on unbounded…

Machine Learning · Computer Science 2025-10-10 Alireza Moradzadeh , Srimukh Prasad Veccham , Lukasz Wawrzyniak , Miles Macklin , Saee G. Paliwal

Algorithmic speedup of training common neural architectures is made difficult by the lack of structure guaranteed by the function compositions inherent to such networks. In contrast to multilayer perceptrons (MLPs), Kolmogorov-Arnold…

Machine Learning · Computer Science 2026-03-06 Ben S. Southworth , Jonas A. Actor , Graham Harper , Eric C. Cyr

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks…

Machine Learning · Computer Science 2024-10-04 Mohammadamin Moradi , Shirin Panahi , Erik Bollt , Ying-Cheng Lai
‹ Prev 1 2 3 10 Next ›