English
Related papers

Related papers: KMLP: A Scalable Hybrid Architecture for Web-Scale…

200 papers

The recently proposed Kolmogorov-Arnold network (KAN) is a promising alternative to multi-layer perceptrons (MLPs) for data-driven modeling. While original KAN layers were only capable of representing the addition operator, the…

Machine Learning · Computer Science 2025-07-28 Benjamin C. Koenig , Suyong Kim , Sili Deng

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Ali Kashefi

Kolmogorov-Arnold Networks (KANs) were proposed as an alternative to traditional neural network architectures based on multilayer perceptrons (MLP-NNs). The potential advantages of KANs over MLP-NNs, including significantly enhanced…

Materials Science · Physics 2026-01-29 Ryan Jacobs , Lane E. Schultz , Dane Morgan

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Machine Learning · Computer Science 2025-02-11 Ziming Liu , Yixuan Wang , Sachin Vaidya , Fabian Ruehle , James Halverson , Marin Soljačić , Thomas Y. Hou , Max Tegmark

To address the issue of interpretability in multilayer perceptrons (MLPs), Kolmogorov-Arnold Networks (KANs) are introduced in 2024. However, optimizing KAN structures is labor-intensive, typically requiring manual intervention and…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Quan Long , Bin Wang , Bing Xue , Mengjie Zhang

Federated Learning (FL) enables model training across decentralized devices without sharing raw data, thereby preserving privacy in sensitive domains like healthcare. In this paper, we evaluate Kolmogorov-Arnold Networks (KAN) architectures…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

This study evaluates the generalization performance and representation efficiency (parsimony) of a previously introduced Tensor Basis Kolmogorov-Arnold Network (TBKAN) architecture for data-driven turbulence modeling. The TBKAN framework…

Fluid Dynamics · Physics 2025-05-27 Nikhila Kalia , Ryley McConkey , Eugene Yee , Fue-Sang Lien

DreamerV3 is a state-of-the-art online model-based reinforcement learning (MBRL) algorithm known for remarkable sample efficiency. Concurrently, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-Layer…

Machine Learning · Computer Science 2025-12-09 Chenwei Shi , Xueyu Luan

Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ali Jamali , Swalpa Kumar Roy , Danfeng Hong , Bing Lu , Pedram Ghamisi

Tabular datasets play a crucial role in various applications. Thus, developing efficient, effective, and widely compatible prediction algorithms for tabular data is important. Currently, two prominent model types, Gradient Boosted Decision…

Machine Learning · Computer Science 2024-07-16 Jiahuan Yan , Jintai Chen , Qianxing Wang , Danny Z. Chen , Jian Wu

To address the challenge of tractability for optimizing mathematical models in science and engineering, surrogate models are often employed. Recently, a new class of machine learning models named Kolmogorov Arnold Networks (KANs) have been…

Optimization and Control · Mathematics 2025-03-05 Tanuj Karia , Giacomo Lastrucci , Artur M. Schweidtmann

Recent developments have introduced Kolmogorov-Arnold Networks (KAN), an innovative architectural paradigm capable of replicating conventional deep neural network (DNN) capabilities while utilizing significantly reduced parameter counts…

Hardware Architecture · Computer Science 2025-09-09 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Kolmogorov-Arnold Networks (KANs) are a recent neural network architecture offering an alternative to Multilayer Perceptrons (MLPs) with improved explainability and expressibility. However, KANs are significantly slower than MLPs due to the…

Machine Learning · Computer Science 2026-04-27 Eduardo Said Merin-Martinez , Andres Mendez-Vazquez , Eduardo Rodriguez-Tello

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

Hardware Architecture · Computer Science 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multilayer Perceptrons (MLPs) in deep learning. KANs have already been integrated into various architectures, such as convolutional neural networks,…

Machine Learning · Computer Science 2025-03-04 Ali Kashefi

The domain of laser fusion presents a unique and challenging predictive modeling application landscape for machine learning methods due to high problem complexity and limited training data. Data-driven approaches utilizing prescribed…

Machine Learning · Computer Science 2024-09-16 Rahman Ejaz , Varchas Gopalaswamy , Riccardo Betti , Aarne Lees , Christopher Kanan

The discovery of high-performance thermoelectric materials requires models that are both accurate and interpretable. Traditional machine learning approaches, while effective at property prediction, often act as black boxes and provide…

Materials Science · Physics 2025-12-15 Marco Fronzi , Michael J. Ford , Kamal Singh Nayal , Olexandr Isayev , Catherine Stampfl

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

Weight-space models learn directly from the parameters of neural networks, enabling tasks such as predicting their accuracy on new datasets. Naive methods -- like applying MLPs to flattened parameters -- perform poorly, making the design of…

Machine Learning · Computer Science 2026-03-03 Guy Bar-Shalom , Ami Tavory , Itay Evron , Maya Bechler-Speicher , Ido Guy , Haggai Maron