English
Related papers

Related papers: ViKANformer: Embedding Kolmogorov Arnold Networks …

200 papers

Kolmogorov-Arnold Networks (KANs) have recently emerged as a promising alternative to traditional neural architectures, yet their application to speech processing remains under explored. This work presents the first investigation of KANs…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Eliana Pastor , Sabato Marco Siniscalchi , Elena Baralis

Physics-Informed Neural Networks (PINNs) have emerged as a robust framework for solving Partial Differential Equations (PDEs) by approximating their solutions via neural networks and imposing physics-based constraints on the loss function.…

Recent developments have introduced Kolmogorov-Arnold Networks (KAN), an innovative architectural paradigm capable of replicating conventional deep neural network (DNN) capabilities while utilizing significantly reduced parameter counts…

Hardware Architecture · Computer Science 2025-09-09 Wei-Hsing Huang , Jianwei Jia , Yuyao Kong , Faaiq Waqar , Tai-Hao Wen , Meng-Fan Chang , Shimeng Yu

Accurate segmentation of individual teeth from panoramic radiographs remains a challenging task due to anatomical variations, irregular tooth shapes, and overlapping structures. These complexities often limit the performance of conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Md Mizanur Rahman Mustakim , Jianwu Li , Sumya Bhuiyan , Mohammad Mehedi Hasan , Bing Han

Massive number of applications involve data with underlying relationships embedded in non-Euclidean space. Graph neural networks (GNNs) are utilized to extract features by capturing the dependencies within graphs. Despite groundbreaking…

Machine Learning · Computer Science 2024-06-21 Fan Zhang , Xin Zhang

Accurate classification of tree species based on Terrestrial Laser Scanning (TLS) and Airborne Laser Scanning (ALS) is essential for biodiversity conservation. While advanced deep learning models for 3D point cloud classification have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Said Ohamouddou , Mohamed Ohamouddou , Hanaa El Afia , Abdellatif El Afia , Rafik Lasri , Raddouane Chiheb

Recent advancements in Lyapunov-based Deep Neural Networks (Lb-DNNs) have demonstrated improved performance over shallow NNs and traditional adaptive control for nonlinear systems with uncertain dynamics. Existing Lb-DNNs rely on…

Systems and Control · Electrical Eng. & Systems 2025-12-29 Xuehui Shen , Wenqian Xue , Yixuan Wang , Warren E. Dixon

In recent years, Graph Neural Networks (GNNs) have become the de facto tool for learning node and graph representations. Most GNNs typically consist of a sequence of neighborhood aggregation (a.k.a., message-passing) layers, within which…

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Vision Transformer (ViT) is emerging as the state-of-the-art architecture for image recognition. While recent studies suggest that ViTs are more robust than their convolutional counterparts, our experiments find that ViTs trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Chengzhi Mao , Lu Jiang , Mostafa Dehghani , Carl Vondrick , Rahul Sukthankar , Irfan Essa

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

Vision Transformers are very popular nowadays due to their state-of-the-art performance in several computer vision tasks, such as image classification and action recognition. Although their performance has been greatly enhanced through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dimitrios Konstantinidis , Ilias Papastratis , Kosmas Dimitropoulos , Petros Daras

Transformers have recently gained increasing attention in computer vision. However, existing studies mostly use Transformers for feature representation learning, e.g. for image classification and dense predictions, and the generalizability…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Shengcai Liao , Ling Shao

Kolmogorov Arnold Networks (KANs) are neural architectures inspired by the Kolmogorov Arnold representation theorem that leverage B Spline parameterizations for flexible, locally adaptive function approximation. Although KANs can capture…

Machine Learning · Computer Science 2025-03-04 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Extensive work has demonstrated the effectiveness of Vision Transformers. The plain Vision Transformer tends to obtain multi-scale features by selecting fixed layers, or the last layer of features aiming to achieve higher performance in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Fangjian Lin , Yizhe Ma , Shengwei Tian

Deep learning-based medical image segmentation has shown remarkable success; however, it typically requires extensive pixel-level annotations, which are both expensive and time-intensive. Semi-supervised medical image segmentation (SSMIS)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zanting Ye , Xiaolong Niu , Xuanbin Wu , Wenxiang Yi , Yuan Chang , Lijun Lu

Face Presentation Attack Detection (PAD) is an important measure to prevent spoof attacks for face biometric systems. Many works based on Convolution Neural Networks (CNNs) for face PAD formulate the problem as an image-level binary…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zuheng Ming , Zitong Yu , Musab Al-Ghadi , Muriel Visani , Muhammad MuzzamilLuqman , Jean-Christophe Burie

Medical image segmentation has traditionally relied on convolutional neural networks (CNNs) and Transformer-based models. CNNs, however, are constrained by limited receptive fields, while Transformers face scalability challenges due to…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Hancan Zhu , Jinhao Chen , Guanghua He

This paper presents, for the first time, a framework for Kolmogorov-Arnold Networks (KANs) in power system applications. Inspired by the recently proposed KAN architecture, this paper proposes physics-informed Kolmogorov-Arnold Networks…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Hang Shuai , Fangxing Li

In the realm of intelligent education, cognitive diagnosis plays a crucial role in subsequent recommendation tasks attributed to the revealed students' proficiency in knowledge concepts. Although neural network-based neural cognitive…

Machine Learning · Computer Science 2024-05-24 Shangshang Yang , Linrui Qin , Xiaoshan Yu