中文
相关论文

相关论文: On the Convergence of (Stochastic) Gradient Descen…

200 篇论文

Kolmogorov Arnold Networks (KANs) are recent architectural advancement in neural computation that offer a mathematically grounded alternative to standard neural networks. This study presents an empirical evaluation of KANs in context of…

机器学习 · 计算机科学 2025-07-21 Pankaj Yadav , Vivek Vijay

Inspired by the Kolmogorov-Arnold representation theorem and Kurkova's principle of using approximate representations, we propose the Kurkova-Kolmogorov-Arnold Network (KKAN), a new two-block architecture that combines robust multi-layer…

机器学习 · 计算机科学 2024-12-24 Juan Diego Toscano , Li-Lian Wang , George Em Karniadakis

In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Minjong Cheon

This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation…

信号处理 · 电气工程与系统科学 2025-10-28 Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Màrius Caus

Recent success of graph neural networks (GNNs) in modeling complex graph-structured data has fueled interest in deploying them on resource-constrained edge devices. However, their substantial computational and memory demands present ongoing…

机器学习 · 计算机科学 2026-02-10 Can Cui , Zilong Fu , Penghe Huang , Yuanyuan Li , Wu Deng , Dongyan Li

Kolmogorov-Arnold Networks (KANs) uniquely combine high accuracy with interpretability, making them valuable for scientific modeling. However, it is unclear a priori how deep a network needs to be for any given task, and deeper KANs can be…

机器学习 · 计算机科学 2025-08-22 James Bagrow , Josh Bongard

Graph Representation Learning aims to create effective embeddings for nodes and edges that encapsulate their features and relationships. Graph Neural Networks (GNNs) leverage neural networks to model complex graph structures. Recently, the…

机器学习 · 计算机科学 2025-01-23 Muhieddine Shebaro , Jelena Tešić

A new Kolmogorov-Arnold network (KAN) is proposed to approximate potentially irregular functions in high dimensions. We provide error bounds for this approximation, assuming that the Kolmogorov-Arnold expansion functions are sufficiently…

机器学习 · 计算机科学 2026-05-05 Xavier Warin

Kolmogorov-Arnold Networks(KANs), as a theoretically efficient neural network architecture, have garnered attention for their potential in capturing complex patterns. However, their application in computer vision remains relatively…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Yueyang Cang , Yu hang liu , Li Shi

The massive size of modern neural networks has motivated substantial recent interest in neural network quantization. We introduce Stochastic Markov Gradient Descent (SMGD), a discrete optimization method applicable to training quantized…

机器学习 · 计算机科学 2020-12-23 Jonathan Ashbrock , Alexander M. Powell

This paper presents the application of Kolmogorov-Arnold Networks (KAN) in classifying metal surface defects. Specifically, steel surfaces are analyzed to detect defects such as cracks, inclusions, patches, pitted surfaces, and scratches.…

机器学习 · 计算机科学 2025-01-22 Maciej Krzywda , Mariusz Wermiński , Szymon Łukasik , Amir H. Gandomi

This paper introduces the Hierarchical Kolmogorov-Arnold Network (HKAN), a novel network architecture that offers a competitive alternative to the recently proposed Kolmogorov-Arnold Network (KAN). Unlike KAN, which relies on…

机器学习 · 计算机科学 2026-01-21 Grzegorz Dudek , Tomasz Rodak

We introduce Graph Kolmogorov-Arnold Networks (GKAN), an innovative neural network architecture that extends the principles of the recently proposed Kolmogorov-Arnold Networks (KAN) to graph-structured data. By adopting the unique…

机器学习 · 计算机科学 2024-06-11 Mehrdad Kiamari , Mohammad Kiamari , Bhaskar Krishnamachari

Multilayer Perceptrons (MLPs) have long been a cornerstone in deep learning, known for their capacity to model complex relationships. Recently, Kolmogorov-Arnold Networks (KANs) have emerged as a compelling alternative, utilizing highly…

机器学习 · 计算机科学 2024-09-17 Farhad Pourkamali-Anaraki

Kolmogorov-Arnold Networks (KAN) has recently attracted significant attention as a promising alternative to traditional Multi-Layer Perceptrons (MLP). Despite their theoretical appeal, KAN require validation on large-scale benchmark…

机器学习 · 计算机科学 2024-09-12 Chang Dong , Liangwei Zheng , Weitong Chen

Kolmogorov-Arnold Networks (KANs) have shown potential as an alternative to Multi-Layer Perceptrons (MLPs) in neural networks, providing universal function approximation with fewer parameters and reduced memory usage. In this paper, we…

We prove that stochastic gradient descent (SGD) finds a solution that achieves $(1-\epsilon)$ classification accuracy on the entire dataset. We do so under two main assumptions: (1. Local progress) The model accuracy improves on average…

机器学习 · 计算机科学 2022-05-17 Gregory Schwartzman

In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Minjong Cheon

The emergence of Kolmogorov-Arnold Networks (KANs) has sparked significant interest and debate within the scientific community. This paper explores the application of KANs in the domain of computer vision (CV). We examine the convolutional…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Ivan Drokin

Kolmogorov-Arnold Networks (KANs), a novel type of neural network, have recently gained popularity and attention due to the ability to substitute multi-layer perceptions (MLPs) in artificial intelligence (AI) with higher accuracy and…