English
Related papers

Related papers: Activation Space Selectable Kolmogorov-Arnold Netw…

200 papers

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A…

Machine Learning · Statistics 2026-05-22 Roberto Cavoretto , Alessandra De Rossi , Adeeba Haider , Amir Noorizadegan

Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distributions, and…

Machine Learning · Computer Science 2026-02-27 Mingming Zhang , Pengfei Shi , Zhiqing Xiao , Feng Zhao , Guandong Sun , Yulin Kang , Ruizhe Gao , Ningtao Wang , Xing Fu , Weiqiang Wang , Junbo Zhao

Recently, multi-layer perceptrons (MLPs) widely used in modern AI applications suffer from limited real-time performance due to intensive memory access overhead. Kolmogorov--Arnold Networks (KANs) have attracted increasing attention as an…

Hardware Architecture · Computer Science 2026-03-03 Wenhui Ou , Zhuoyu Wu , Yipu Zhang , Zheng Wang , C. Patrick Yue

Image-to-Image translation in Generative Artificial Intelligence (Generative AI) has been a central focus of research, with applications spanning healthcare, remote sensing, physics, chemistry, photography, and more. Among the numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Arpan Mahara , Naphtali D. Rishe , Liangdong Deng

Kolmogorov-Arnold Networks (KANs) offer a structured and interpretable framework for multivariate function approximation by composing univariate transformations through additive or multiplicative aggregation. This paper establishes…

Machine Learning · Computer Science 2025-12-05 Wei Liu , Eleni Chatzi , Zhilu Lai

In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a…

Machine Learning · Computer Science 2024-06-19 Mengxi Liu , Daniel Geißler , Dominique Nshimyimana , Sizhen Bian , Bo Zhou , Paul Lukowicz

We present a novel approach to predicting the pressure and flow rate of flexible electrohydrodynamic pumps using the Kolmogorov-Arnold Network. Inspired by the Kolmogorov-Arnold representation theorem, KAN replaces fixed activation…

Machine Learning · Computer Science 2024-12-31 Yanhong Peng , Yuxin Wang , Fangchao Hu , Miao He , Zebing Mao , Xia Huang , Jun Ding

Weight-space models learn directly from the parameters of neural networks, enabling tasks such as predicting their accuracy on new datasets. Naive methods -- like applying MLPs to flattened parameters -- perform poorly, making the design of…

Machine Learning · Computer Science 2026-03-03 Guy Bar-Shalom , Ami Tavory , Itay Evron , Maya Bechler-Speicher , Ido Guy , Haggai Maron

Semantic segmentation plays a crucial role in remote sensing applications, where the accurate extraction and representation of features are essential for high-quality results. Despite the widespread use of encoder-decoder architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xianping Ma , Ziyao Wang , Yin Hu , Xiaokang Zhang , Man-On Pun

Kolmogorov-Arnold Neural Networks (KANs) have gained significant attention in the machine learning community. However, their implementation often suffers from poor training stability and heavy trainable parameter. Furthermore, there is…

Machine Learning · Computer Science 2025-01-17 Liangwewi Nathan Zheng , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

The increasing use of machine learning in clinical decision support has been limited by the lack of transparency of many high-performing models. In clinical settings, predictions must be interpretable, auditable, and actionable. This study…

Recurrent Neural Networks (RNNs) have revolutionized many areas of machine learning, particularly in natural language and data sequence processing. Long Short-Term Memory (LSTM) has demonstrated its ability to capture long-term dependencies…

Machine Learning · Computer Science 2025-08-01 Remi Genet , Hugo Inzirillo

Federated Learning (FL) enables model training across decentralized devices without sharing raw data, thereby preserving privacy in sensitive domains like healthcare. In this paper, we evaluate Kolmogorov-Arnold Networks (KAN) architectures…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Kolmogorov-Arnold Networks (KANs) shift neural computation from linear layers to learnable nonlinear edge functions, but implementing these nonlinearities efficiently in hardware remains an open challenge. Here we introduce a physical…

The rapid development of deepfake generation techniques necessitates robust face forgery detection algorithms. While methods based on Convolutional Neural Networks (CNNs) and Transformers are effective, there is still room for improvement…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiayao Jiang , Bin Liu , Qi Chu , Nenghai Yu

Recent advancements in speech synthesis technologies have led to increasingly sophisticated spoofing attacks, posing significant challenges for automatic speaker verification systems. While systems based on self-supervised learning (SSL)…

Sound · Computer Science 2025-10-09 Phuong Tuan Dat , Tran Huy Dat

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

Recent advancements in Lyapunov-based Deep Neural Networks (Lb-DNNs) have demonstrated improved performance over shallow NNs and traditional adaptive control for nonlinear systems with uncertain dynamics. Existing Lb-DNNs rely on…

Systems and Control · Electrical Eng. & Systems 2025-12-29 Xuehui Shen , Wenqian Xue , Yixuan Wang , Warren E. Dixon

Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. However, transfer learning of KANs remains a relatively…

Machine Learning · Computer Science 2025-02-17 Yihang Gao , Michael K. Ng , Vincent Y. F. Tan

Inspired by the Kolmogorov-Arnold representation theorem, KANs offer a novel framework for function approximation by replacing traditional neural network weights with learnable univariate functions. This design demonstrates significant…

Machine Learning · Computer Science 2025-06-10 Zhangchi Zhao , Jun Shu , Deyu Meng , Zongben Xu