中文
相关论文

相关论文: Kolmogorov-Arnold Attention: Is Learnable Attentio…

200 篇论文

Kolmogorov-Arnold Networks (KANs) replace scalar weights with per-edge vectors of basis coefficients, thereby increasing expressivity and accuracy while also resulting in a multiplicative increase in parameters and memory. We propose…

机器学习 · 计算机科学 2026-02-10 Matthew Raffel , Adwaith Renjith , Lizhong Chen

Kolmogorov-Arnold Networks (KAN) models were recently proposed and claimed to provide improved parameter scaling and interpretability compared to conventional multilayer perceptron (MLP) models. Inspired by the KAN architecture, we propose…

Kolmogorov-Arnold Networks (KANs) are emerging as a powerful framework for interpretable and efficient system identification in dynamic systems. By leveraging the Kolmogorov-Arnold representation theorem, KANs enable function approximation…

机器学习 · 计算机科学 2025-06-13 Nart Gashi , Panagiotis Kakosimos , George Papafotiou

Recent work has established an alternative to traditional multi-layer perceptron neural networks in the form of Kolmogorov-Arnold Networks (KAN). The general KAN framework uses learnable activation functions on the edges of the…

机器学习 · 计算机科学 2025-01-28 Eric A. F. Reinhardt , P. R. Dinesh , Sergei Gleyzer

Recently, a novel model named Kolmogorov-Arnold Networks (KAN) has been proposed with the potential to achieve the functionality of traditional deep neural networks (DNNs) using orders of magnitude fewer parameters by parameterized B-spline…

硬件体系结构 · 计算机科学 2024-09-19 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Quantum architecture Search (QAS) is a promising direction for optimization and automated design of quantum circuits towards quantum advantage. Recent techniques in QAS emphasize Multi-Layer Perceptron (MLP)-based deep Q-networks. However,…

量子物理 · 物理学 2024-12-13 Akash Kundu , Aritra Sarkar , Abhishek Sadhu

While most modern machine learning methods offer speed and accuracy, few promise interpretability or explainability -- two key features necessary for highly sensitive industries, like medicine, finance, and engineering. Using eight datasets…

机器学习 · 计算机科学 2025-04-08 Nataly R. Panczyk , Omer F. Erdem , Majdi I. Radaideh

Kolmogorov-Arnold Networks (KANs) have garnered attention for replacing fixed activation functions with learnable univariate functions, but they exhibit practical limitations, including high computational costs and performance deficits in…

机器学习 · 计算机科学 2025-07-08 Hanseon Joo , Hayoung Choi , Ook Lee , Minjong Cheon

In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Minjong Cheon

Hyperspectral image classification is a crucial but challenging task due to the high dimensionality and complex spatial-spectral correlations inherent in hyperspectral data. This paper employs Wavelet-based Kolmogorov-Arnold Network…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Seyd Teymoor Seydi , Zavareh Bozorgasl , Hao Chen

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to traditional Multilayer Perceptrons (MLPs) in deep learning. KANs have already been integrated into various architectures, such as convolutional neural networks,…

机器学习 · 计算机科学 2025-03-04 Ali Kashefi

Following the success of dot-product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input length. While these variants are memory and compute efficient,…

计算与语言 · 计算机科学 2021-06-15 Ankit Gupta , Guy Dar , Shaya Goodman , David Ciprut , Jonathan Berant

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and…

机器学习 · 计算机科学 2024-05-28 Moein E. Samadi , Younes Müller , Andreas Schuppert

The transformer architecture has catalyzed revolutionary advances in language modeling. However, recent architectural recipes, such as state-space models, have bridged the performance gap. Motivated by this, we examine the benefits of…

机器学习 · 计算机科学 2024-07-09 Mingchen Li , Xuechen Zhang , Yixiao Huang , Samet Oymak

This paper presents the use of Kolmogorov-Arnold Networks (KANs) for forecasting the CBOE Volatility Index (VIX). Unlike traditional MLP-based neural networks that are often criticized for their black-box nature, KAN offers an interpretable…

机器学习 · 计算机科学 2025-02-04 So-Yoon Cho , Sungchul Lee , Hyun-Gyoon Kim

Kolmogorov-Arnold Networks (KAN) \cite{liu2024kan} were very recently proposed as a potential alternative to the prevalent architectural backbone of many deep learning models, the multi-layer perceptron (MLP). KANs have seen success in…

机器学习 · 计算机科学 2025-02-10 Yixuan Wang , Jonathan W. Siegel , Ziming Liu , Thomas Y. Hou

Variational quantum circuits (VQCs) are central to quantum machine learning, while recent progress in Kolmogorov-Arnold networks (KANs) highlights the power of learnable activation functions. We unify these directions by introducing quantum…

量子物理 · 物理学 2025-09-18 Jiun-Cheng Jiang , Morris Yu-Chao Huang , Tianlong Chen , Hsi-Sheng Goan

The application of machine learning methodologies for predicting properties within materials science has garnered significant attention. Among recent advancements, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to…

计算物理 · 物理学 2024-09-06 Rui Wang , Hongyu Yu , Yang Zhong , Hongjun Xiang

Kolmogorov-Arnold Networks (KANs) were proposed as an alternative to traditional neural network architectures based on multilayer perceptrons (MLP-NNs). The potential advantages of KANs over MLP-NNs, including significantly enhanced…

材料科学 · 物理学 2026-01-29 Ryan Jacobs , Lane E. Schultz , Dane Morgan

The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold…

机器学习 · 计算机科学 2024-12-19 Ruichen Qiu , Yibo Miao , Shiwen Wang , Lijia Yu , Yifan Zhu , Xiao-Shan Gao