中文
相关论文

相关论文: Kolmogorov-Arnold Attention: Is Learnable Attentio…

200 篇论文

The field of scientific machine learning, which originally utilized multilayer perceptrons (MLPs), is increasingly adopting Kolmogorov-Arnold Networks (KANs) for data encoding. This shift is driven by the limitations of MLPs, including poor…

机器学习 · 计算机科学 2025-11-04 Salah A. Faroughi , Farinaz Mostajeran , Amin Hamed Mashhadzadeh , Shirko Faroughi

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By replacing…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Alexander Dylan Bodner , Antonio Santiago Tepsich , Jack Natan Spolski , Santiago Pourteau

Kolmogorov-Arnold Networks (KANs) have gained significant attention as an alternative to traditional multilayer perceptrons, with proponents claiming superior interpretability and performance through learnable univariate activation…

机器学习 · 计算机科学 2025-09-16 Yuntian Hou , Tianrui Ji , Di Zhang , Angelos Stefanidis

Kolmogorov-Arnold Networks (KANs), a novel type of neural network, have recently gained popularity and attention due to the ability to substitute multi-layer perceptions (MLPs) in artificial intelligence (AI) with higher accuracy and…

The Kolmogorov-Arnold Network (KAN) has recently gained attention as an alternative to traditional multi-layer perceptrons (MLPs), offering improved accuracy and interpretability by employing learnable activation functions on edges. In this…

机器学习 · 计算机科学 2025-01-03 Fangchen Yu , Ruilizhen Hu , Yidong Lin , Yuqi Ma , Zhenghao Huang , Wenye Li

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

机器学习 · 计算机科学 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have…

Kolmogorov-Arnold Networks (KANs) have recently emerged as a promising alternative to traditional neural architectures, yet their application to speech processing remains under explored. This work presents the first investigation of KANs…

计算与语言 · 计算机科学 2025-05-27 Alkis Koudounas , Moreno La Quatra , Eliana Pastor , Sabato Marco Siniscalchi , Elena Baralis

The research undertakes a comprehensive comparative analysis of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptrons (MLP), highlighting their effectiveness in solving essential computational challenges like nonlinear function…

机器学习 · 计算机科学 2026-01-16 Aradhya Gaonkar , Nihal Jain , Vignesh Chougule , Nikhil Deshpande , Sneha Varur , Channabasappa Muttal

Multilayer Perceptron (MLP), as a simple yet powerful model, continues to be widely used in classification and regression tasks. However, traditional MLPs often struggle to efficiently capture nonlinear relationships in load data when…

机器学习 · 计算机科学 2025-05-13 Yizhou Ma , Zhuoqin Yang , Luis-Daniel Ibáñez

By utilising their adaptive activation functions, Kolmogorov-Arnold Networks (KANs) can be applied in a novel way for the diverse machine learning tasks, including cyber threat detection. KANs substitute conventional linear weights with…

密码学与安全 · 计算机科学 2026-04-01 Mohammed Hassanin

This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation…

信号处理 · 电气工程与系统科学 2025-10-28 Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Màrius Caus

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks…

机器学习 · 计算机科学 2024-10-04 Mohammadamin Moradi , Shirin Panahi , Erik Bollt , Ying-Cheng Lai

Kolmogorov-Arnold Networks (KANs) are a recently introduced neural architecture that replace fixed nonlinearities with trainable activation functions, offering enhanced flexibility and interpretability. While KANs have been applied…

机器学习 · 计算机科学 2026-03-31 Spyros Rigas , Dhruv Verma , Georgios Alexandridis , Yixuan Wang

Kolmogorov-Arnold Networks (KANs) have inspired numerous works exploring their applications across a wide range of scientific problems, with the potential to replace Multilayer Perceptrons (MLPs). While many KANs are designed using basis…

机器学习 · 计算机科学 2025-03-11 Hoang-Thang Ta , Anh Tran

The emergence of Kolmogorov-Arnold Networks (KANs) has sparked significant interest and debate within the scientific community. This paper explores the application of KANs in the domain of computer vision (CV). We examine the convolutional…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Ivan Drokin

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Wayner Barrios , SouYoung Jin

Algorithmic speedup of training common neural architectures is made difficult by the lack of structure guaranteed by the function compositions inherent to such networks. In contrast to multilayer perceptrons (MLPs), Kolmogorov-Arnold…

机器学习 · 计算机科学 2026-03-06 Ben S. Southworth , Jonas A. Actor , Graham Harper , Eric C. Cyr

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

Symbolic neural networks, such as Kolmogorov-Arnold Networks (KAN), offer a promising approach for integrating prior knowledge with data-driven methods, making them valuable for addressing inverse problems in scientific and engineering…

机器学习 · 计算机科学 2024-11-05 Xia Chen , Guoquan Lv , Xinwei Zhuang , Carlos Duarte , Stefano Schiavon , Philipp Geyer