中文
相关论文

相关论文: AF-KAN: Activation Function-Based Kolmogorov-Arnol…

200 篇论文

We explore the integration of Kolmogorov Networks (KANs) into molecular dynamics (MD) simulations to improve interatomic potentials. We propose that widely used potentials, such as the Lennard-Jones (LJ) potential, the embedded atom model…

材料科学 · 物理学 2024-07-26 Yuki Nagai , Masahiko Okumura

Recent advancements in Lyapunov-based Deep Neural Networks (Lb-DNNs) have demonstrated improved performance over shallow NNs and traditional adaptive control for nonlinear systems with uncertain dynamics. Existing Lb-DNNs rely on…

系统与控制 · 电气工程与系统科学 2025-12-29 Xuehui Shen , Wenqian Xue , Yixuan Wang , Warren E. Dixon

The widespread use of Multi-layer perceptrons (MLPs) often relies on a fixed activation function (e.g., ReLU, Sigmoid, Tanh) for all nodes within the hidden layers. While effective in many scenarios, this uniformity may limit the networks…

机器学习 · 计算机科学 2025-04-28 Hy Nguyen , Duy Khoa Pham , Srikanth Thudumu , Hung Du , Rajesh Vasa , Kon Mouzakis

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

机器学习 · 计算机科学 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Graph neural networks (GNNs) excel in learning from network-like data but often lack interpretability, making their application challenging in domains requiring transparent decision-making. We propose the Graph Kolmogorov-Arnold Network…

机器学习 · 计算机科学 2025-06-02 Gianluca De Carlo , Andrea Mastropietro , Aris Anagnostopoulos

Graph Representation Learning aims to create effective embeddings for nodes and edges that encapsulate their features and relationships. Graph Neural Networks (GNNs) leverage neural networks to model complex graph structures. Recently, the…

机器学习 · 计算机科学 2025-01-23 Muhieddine Shebaro , Jelena Tešić

Implicit neural representations (INRs) use neural networks to provide continuous and resolution-independent representations of complex signals with a small number of parameters. However, existing INR models often fail to capture important…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Ali Mehrabian , Parsa Mojarad Adi , Moein Heidari , Ilker Hacihaliloglu

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

机器学习 · 计算机科学 2025-06-24 Ali Kashefi , Tapan Mukerji

Hypergraph representation learning has garnered increasing attention across various domains due to its capability to model high-order relationships. Traditional methods often rely on hypergraph neural networks (HNNs) employing message…

机器学习 · 计算机科学 2025-03-18 Xiangfei Fang , Boying Wang , Chengying Huan , Shaonan Ma , Heng Zhang , Chen Zhao

Kolmogorov-Arnold networks (KANs) are a remarkable innovation that consists of learnable activation functions, with the potential to capture more complex relationships from data. Presently, KANs are deployed by replacing multilayer…

机器学习 · 计算机科学 2025-10-23 Subhajit Maity , Killian Hitsman , Xin Li , Aritra Dutta

Semantic segmentation plays a crucial role in remote sensing applications, where the accurate extraction and representation of features are essential for high-quality results. Despite the widespread use of encoder-decoder architectures,…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Xianping Ma , Ziyao Wang , Yin Hu , Xiaokang Zhang , Man-On Pun

We propose DropKAN (Dropout Kolmogorov-Arnold Networks) a regularization method that prevents co-adaptation of activation function weights in Kolmogorov-Arnold Networks (KANs). DropKAN functions by embedding the drop mask directly within…

机器学习 · 计算机科学 2024-08-21 Mohammed Ghaith Altarabichi

The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamental multivariate function. In this work, we investigate the…

机器学习 · 计算机科学 2024-07-31 Mohammed Ghaith Altarabichi

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

硬件体系结构 · 计算机科学 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

We propose a novel approach that enhances multivariate function approximation using learnable path signatures and Kolmogorov-Arnold networks (KANs). We enhance the learning capabilities of these networks by weighting the values obtained by…

机器学习 · 计算机科学 2024-12-10 Hugo Inzirillo , Remi Genet

Due to their effective performance, Convolutional Neural Network (CNN) and Vision Transformer (ViT) architectures have become the standard for solving computer vision tasks. Such architectures require large data sets and rely on convolution…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Jorge Luiz dos Santos Canuto , Linnyer Beatrys Ruiz Aylon , Rodrigo Clemente Thom de Souza

The highly nonlinear degradation process, complex physical interactions, and various sources of uncertainty render single-image Super-resolution (SR) a particularly challenging task. Existing interpretable SR approaches, whether based on…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Jocelyn Chanussot

This paper presents, for the first time, a framework for Kolmogorov-Arnold Networks (KANs) in power system applications. Inspired by the recently proposed KAN architecture, this paper proposes physics-informed Kolmogorov-Arnold Networks…

系统与控制 · 电气工程与系统科学 2025-06-05 Hang Shuai , Fangxing Li

The present paper introduces concurrency-driven enhancements to the training algorithm for the Kolmogorov-Arnold networks (KANs) that is based on the Newton-Kaczmarz (NK) method. Prior research shows that KANs trained using the NK-based…

机器学习 · 计算机科学 2026-03-30 Andrew Polar , Michael Poluektov

The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional…

硬件体系结构 · 计算机科学 2025-04-15 Dhruv Kulkarni , Bharat Bhammar , Henil Thaker , Pranav Dhobi , R. P. Gohil , Sai Manoj Pudukotai Dinkarrao