English
Related papers

Related papers: AF-KAN: Activation Function-Based Kolmogorov-Arnol…

200 papers

We explore the integration of Kolmogorov Networks (KANs) into molecular dynamics (MD) simulations to improve interatomic potentials. We propose that widely used potentials, such as the Lennard-Jones (LJ) potential, the embedded atom model…

Materials Science · Physics 2024-07-26 Yuki Nagai , Masahiko Okumura

Recent advancements in Lyapunov-based Deep Neural Networks (Lb-DNNs) have demonstrated improved performance over shallow NNs and traditional adaptive control for nonlinear systems with uncertain dynamics. Existing Lb-DNNs rely on…

Systems and Control · Electrical Eng. & Systems 2025-12-29 Xuehui Shen , Wenqian Xue , Yixuan Wang , Warren E. Dixon

The widespread use of Multi-layer perceptrons (MLPs) often relies on a fixed activation function (e.g., ReLU, Sigmoid, Tanh) for all nodes within the hidden layers. While effective in many scenarios, this uniformity may limit the networks…

Machine Learning · Computer Science 2025-04-28 Hy Nguyen , Duy Khoa Pham , Srikanth Thudumu , Hung Du , Rajesh Vasa , Kon Mouzakis

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Graph neural networks (GNNs) excel in learning from network-like data but often lack interpretability, making their application challenging in domains requiring transparent decision-making. We propose the Graph Kolmogorov-Arnold Network…

Machine Learning · Computer Science 2025-06-02 Gianluca De Carlo , Andrea Mastropietro , Aris Anagnostopoulos

Graph Representation Learning aims to create effective embeddings for nodes and edges that encapsulate their features and relationships. Graph Neural Networks (GNNs) leverage neural networks to model complex graph structures. Recently, the…

Machine Learning · Computer Science 2025-01-23 Muhieddine Shebaro , Jelena Tešić

Implicit neural representations (INRs) use neural networks to provide continuous and resolution-independent representations of complex signals with a small number of parameters. However, existing INR models often fail to capture important…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Ali Mehrabian , Parsa Mojarad Adi , Moein Heidari , Ilker Hacihaliloglu

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

Machine Learning · Computer Science 2025-06-24 Ali Kashefi , Tapan Mukerji

Hypergraph representation learning has garnered increasing attention across various domains due to its capability to model high-order relationships. Traditional methods often rely on hypergraph neural networks (HNNs) employing message…

Machine Learning · Computer Science 2025-03-18 Xiangfei Fang , Boying Wang , Chengying Huan , Shaonan Ma , Heng Zhang , Chen Zhao

Kolmogorov-Arnold networks (KANs) are a remarkable innovation that consists of learnable activation functions, with the potential to capture more complex relationships from data. Presently, KANs are deployed by replacing multilayer…

Machine Learning · Computer Science 2025-10-23 Subhajit Maity , Killian Hitsman , Xin Li , Aritra Dutta

Semantic segmentation plays a crucial role in remote sensing applications, where the accurate extraction and representation of features are essential for high-quality results. Despite the widespread use of encoder-decoder architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xianping Ma , Ziyao Wang , Yin Hu , Xiaokang Zhang , Man-On Pun

We propose DropKAN (Dropout Kolmogorov-Arnold Networks) a regularization method that prevents co-adaptation of activation function weights in Kolmogorov-Arnold Networks (KANs). DropKAN functions by embedding the drop mask directly within…

Machine Learning · Computer Science 2024-08-21 Mohammed Ghaith Altarabichi

The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamental multivariate function. In this work, we investigate the…

Machine Learning · Computer Science 2024-07-31 Mohammed Ghaith Altarabichi

Ultrafast online learning is essential for high-frequency systems, such as controls for quantum computing and nuclear fusion, where adaptation must occur on sub-microsecond timescales. Meeting these requirements demands low-latency,…

Hardware Architecture · Computer Science 2026-05-05 Duc Hoang , Aarush Gupta , Philip Harris

We propose a novel approach that enhances multivariate function approximation using learnable path signatures and Kolmogorov-Arnold networks (KANs). We enhance the learning capabilities of these networks by weighting the values obtained by…

Machine Learning · Computer Science 2024-12-10 Hugo Inzirillo , Remi Genet

Due to their effective performance, Convolutional Neural Network (CNN) and Vision Transformer (ViT) architectures have become the standard for solving computer vision tasks. Such architectures require large data sets and rely on convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jorge Luiz dos Santos Canuto , Linnyer Beatrys Ruiz Aylon , Rodrigo Clemente Thom de Souza

The highly nonlinear degradation process, complex physical interactions, and various sources of uncertainty render single-image Super-resolution (SR) a particularly challenging task. Existing interpretable SR approaches, whether based on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Jocelyn Chanussot

This paper presents, for the first time, a framework for Kolmogorov-Arnold Networks (KANs) in power system applications. Inspired by the recently proposed KAN architecture, this paper proposes physics-informed Kolmogorov-Arnold Networks…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Hang Shuai , Fangxing Li

The present paper introduces concurrency-driven enhancements to the training algorithm for the Kolmogorov-Arnold networks (KANs) that is based on the Newton-Kaczmarz (NK) method. Prior research shows that KANs trained using the NK-based…

Machine Learning · Computer Science 2026-03-30 Andrew Polar , Michael Poluektov

The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional…

Hardware Architecture · Computer Science 2025-04-15 Dhruv Kulkarni , Bharat Bhammar , Henil Thaker , Pranav Dhobi , R. P. Gohil , Sai Manoj Pudukotai Dinkarrao