中文
相关论文

相关论文: PowerMLP: An Efficient Version of KAN

200 篇论文

There is increasing interest in solving partial differential equations (PDEs) by casting them as machine learning problems. Recently, there has been a spike in exploring Kolmogorov-Arnold Networks (KANs) as an alternative to traditional…

机器学习 · 计算机科学 2025-04-16 Raghav Pant , Sikan Li , Xingjian Li , Hassan Iqbal , Krishna Kumar

Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving…

机器学习 · 计算机科学 2024-06-06 Khemraj Shukla , Juan Diego Toscano , Zhicheng Wang , Zongren Zou , George Em Karniadakis

Kolmogorov-Arnold Networks (KAN) has recently attracted significant attention as a promising alternative to traditional Multi-Layer Perceptrons (MLP). Despite their theoretical appeal, KAN require validation on large-scale benchmark…

机器学习 · 计算机科学 2024-09-12 Chang Dong , Liangwei Zheng , Weitong Chen

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

机器学习 · 计算机科学 2025-03-11 Hoang-Thang Ta , Anh Tran

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Minjong Cheon

Low-latency, resource-efficient neural network inference on FPGAs is essential for applications demanding real-time capability and low power. Lookup table (LUT)-based neural networks are a common solution, combining strong representational…

硬件体系结构 · 计算机科学 2026-02-19 Duc Hoang , Aarush Gupta , Philip Harris

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

机器学习 · 计算机科学 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or…

机器学习 · 计算机科学 2025-01-24 Eleonora Poeta , Flavio Giobergia , Eliana Pastor , Tania Cerquitelli , Elena Baralis

Transformers stand as the cornerstone of mordern deep learning. Traditionally, these models rely on multi-layer perceptron (MLP) layers to mix the information between channels. In this paper, we introduce the Kolmogorov-Arnold Transformer…

机器学习 · 计算机科学 2024-09-18 Xingyi Yang , Xinchao Wang

Kolmogorov-Arnold Networks have recently been introduced as a flexible alternative to multi-layer Perceptron architectures. In this paper, we examine the training dynamics of different KAN architectures and compare them with corresponding…

机器学习 · 计算机科学 2024-11-11 Shairoz Sohail

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

机器学习 · 计算机科学 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

Kolmogorov-Arnold Networks (KANs) relocate learnable nonlinearities from nodes to edges, demonstrating remarkable capabilities in scientific machine learning and interpretable modeling. However, current KAN implementations suffer from…

神经与进化计算 · 计算机科学 2025-09-25 Alastair Poole , Stig McArthur , Saravan Kumar

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By replacing…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Alexander Dylan Bodner , Antonio Santiago Tepsich , Jack Natan Spolski , Santiago Pourteau

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

机器学习 · 计算机科学 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks…

机器学习 · 计算机科学 2024-10-04 Mohammadamin Moradi , Shirin Panahi , Erik Bollt , Ying-Cheng Lai

Time series classification is a relevant step supporting decision-making processes in various domains, and deep neural models have shown promising performance in this respect. Despite significant advancements in deep learning, the…

机器学习 · 计算机科学 2025-11-04 Irina Barašin , Blaž Bertalanič , Mihael Mohorčič , Carolina Fortuna

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

硬件体系结构 · 计算机科学 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

Kolmogorov-Arnold Networks (KANs) were proposed as an alternative to traditional neural network architectures based on multilayer perceptrons (MLP-NNs). The potential advantages of KANs over MLP-NNs, including significantly enhanced…

材料科学 · 物理学 2026-01-29 Ryan Jacobs , Lane E. Schultz , Dane Morgan

Kolmogorov-Arnold Networks (KANs) have garnered attention for replacing fixed activation functions with learnable univariate functions, but they exhibit practical limitations, including high computational costs and performance deficits in…

机器学习 · 计算机科学 2025-07-08 Hanseon Joo , Hayoung Choi , Ook Lee , Minjong Cheon

This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to…

机器学习 · 计算机科学 2024-09-13 Sheng Shen , Rabih Younes