English
Related papers

Related papers: DropKAN: Regularizing KANs by masking post-activat…

200 papers

Kolmogorov-Arnold Networks (KANs) have been recently proposed as a machine learning framework that is more interpretable and controllable than the multi-layer perceptron. Various network architectures have been proposed within the KAN…

Machine Learning · Computer Science 2025-02-21 Tatiana Boura , Stasinos Konstantopoulos

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and…

Machine Learning · Computer Science 2024-05-28 Moein E. Samadi , Younes Müller , Andreas Schuppert

Deep learning methods have been widely used as an end-to-end modeling strategy of electrical energy systems because of their conveniency and powerful pattern recognition capability. However, due to the "closed-box" nature, deep learning…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Zhenghao Zhou , Yiyan Li , Zelin Guo , Zheng Yan , Mo-Yuen Chow

Kolmogorov Arnold Networks (KANs) represent a new class of neural architectures that replace conventional linear transformations and node-based nonlinearities with spline-based function approximations distributed along network edges.…

Machine Learning · Computer Science 2026-01-30 Kazi Ahmed Asif Fuad , Lizhong Chen

Dropout as a common regularizer to prevent overfitting in deep neural networks has been less effective in convolutional layers than in fully connected layers. This is because Dropout drops features randomly, without considering local…

Machine Learning · Computer Science 2025-06-05 Liyan Chen , Philippos Mordohai , Sergul Aydore

The Kolmogorov-Arnold Network (KAN) has emerged as a promising neural network architecture for small-scale AI+Science applications. However, it suffers from inflexibility in modeling ridge functions, which is widely used in representing the…

Computational Physics · Physics 2025-04-10 Zhiteng Zhou , Zhaoyue Xu , Yi Liu , Shizhao Wang

The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold…

Machine Learning · Computer Science 2024-12-19 Ruichen Qiu , Yibo Miao , Shiwen Wang , Lijia Yu , Yifan Zhu , Xiao-Shan Gao

Kolmogorov-Arnold Networks (KANs) offer a promising framework for approximating complex nonlinear functions, yet the original B-spline formulation suffers from significant computational overhead due to De Boor algorithm. While recent…

Machine Learning · Computer Science 2026-02-10 Shao-Ting Chiu , Siu Wun Cheung , Ulisses Braga-Neto , Chak Shing Lee , Rui Peng Li

Deep neural network (DNN)-based adaptive controllers can be used to compensate for unstructured uncertainties in nonlinear dynamic systems. However, DNNs are also very susceptible to overfitting and co-adaptation. Dropout regularization is…

Systems and Control · Electrical Eng. & Systems 2023-11-01 Saiedeh Akbari , Emily J. Griffis , Omkar Sudhir Patil , Warren E. Dixon

Kolmogorov-Arnold Networks (KANs) have demonstrated an exceptional ability to learn complex functions on clean, low-dimensional data but struggle to maintain performance on noisy and imperfect real-world datasets. In contrast, conventional…

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

Machine Learning · Computer Science 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Recent advancements in Lyapunov-based Deep Neural Networks (Lb-DNNs) have demonstrated improved performance over shallow NNs and traditional adaptive control for nonlinear systems with uncertain dynamics. Existing Lb-DNNs rely on…

Systems and Control · Electrical Eng. & Systems 2025-12-29 Xuehui Shen , Wenqian Xue , Yixuan Wang , Warren E. Dixon

Artificial Neural Networks (ANNs) have significantly advanced various fields by effectively recognizing patterns and solving complex problems. Despite these advancements, their interpretability remains a critical challenge, especially in…

Machine Learning · Computer Science 2025-11-24 Alejandro Polo-Molina , David Alfaya , Jose Portela

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

Existing low-light image enhancement methods are difficult to fit the complex nonlinear relationship between normal and low-light images due to uneven illumination and noise effects. The recently proposed Kolmogorov-Arnold networks (KANs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Aoxiang Ning , Minglong Xue , Jinhong He , Chengyun Song

Effective molecular representation learning is crucial for advancing molecular property prediction and drug design. Mainstream molecular representation learning approaches are based on Graph Neural Networks (GNNs). However, these approaches…

Machine Learning · Computer Science 2024-11-12 Ruifeng Li , Mingqian Li , Wei Liu , Hongyang Chen

The Kolmogorov-Arnold representation theorem states that any continuous multivariable function can be exactly represented as a finite superposition of continuous single variable functions. Subsequent simplifications of this representation…

Machine Learning · Statistics 2025-08-04 Sergei Gleyzer , Hanh Nguyen , Dinesh P. Ramakrishnan , Eric A. F. Reinhardt

Kolmogorov-Arnold Networks (KANs) have emerged as a transformative model paradigm, significantly impacting various fields. However, their adversarial robustness remains less underexplored, especially across different KAN architectures. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Songping Wang , Xinquan Yue , Yueming Lyu , Caifeng Shan

DreamerV3 is a state-of-the-art online model-based reinforcement learning (MBRL) algorithm known for remarkable sample efficiency. Concurrently, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-Layer…

Machine Learning · Computer Science 2025-12-09 Chenwei Shi , Xueyu Luan

The multilayer perceptron (MLP), a fundamental paradigm in current artificial intelligence, is widely applied in fields such as computer vision and natural language processing. However, the recently proposed Kolmogorov-Arnold Network (KAN),…

Machine Learning · Computer Science 2024-08-19 Zhuoqin Yang , Jiansong Zhang , Xiaoling Luo , Zheng Lu , Linlin Shen