English
Related papers

Related papers: A Dynamic Framework for Grid Adaptation in Kolmogo…

200 papers

Catastrophic forgetting remains the central obstacle in continual learning (CL): parameters shared across tasks interfere with one another, and existing regularization methods such as EWC and SI apply uniform penalties without awareness of…

Machine Learning · Computer Science 2026-05-13 Minjong Cheon

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

Kolmogorov-Arnold Networks (KANs), whose design is inspired-rather than dictated-by the Kolmogorov superposition theorem, have emerged as a structured alternative to MLPs. This review provides a systematic and comprehensive overview of the…

Machine Learning · Computer Science 2026-05-28 Amir Noorizadegan , Sifan Wang , Leevan Ling , Juan P. Dominguez-Morales

The Kolmogorov-Arnold Network (KAN) is a novel multi-layer network model recognized for its efficiency in neuromorphic computing, where synapses between neurons are trained linearly. Computations in KAN are performed by generating a…

Quantum Physics · Physics 2025-12-19 Hikaru Wakaura , Rahmat Mulyawan , Andriyan B. Suksmono

Kolmogorov GAM (K-GAM) networks are shown to be an efficient architecture for training and inference. They are an additive model with an embedding that is independent of the function of interest. They provide an alternative to the…

Machine Learning · Computer Science 2025-01-03 Sarah Polson , Vadim Sokolov

Kolmogorov-Arnold Networks (KANs) are emerging as a powerful framework for interpretable and efficient system identification in dynamic systems. By leveraging the Kolmogorov-Arnold representation theorem, KANs enable function approximation…

Machine Learning · Computer Science 2025-06-13 Nart Gashi , Panagiotis Kakosimos , George Papafotiou

Kolmogorov-Arnold Networks (KANs) have gained attention as an alternative to traditional multilayer perceptrons (MLPs) for deep learning applications in computational physics, particularly for solving inverse problems with sparse data, as…

Machine Learning · Computer Science 2025-06-24 Ali Kashefi , Tapan Mukerji

Sets represent a fundamental abstraction across many types of data. To handle the unordered nature of set-structured data, models such as DeepSets and PointNet rely on fixed, non-learnable pooling operations (e.g., sum or max) -- a design…

Machine Learning · Computer Science 2026-02-06 Tomas Tokar , Scott Sanner

The need for scalable and expressive models in machine learning is paramount, particularly in applications requiring both structural depth and flexibility. Traditional deep learning methods, such as multilayer perceptrons (MLP), offer depth…

Machine Learning · Computer Science 2024-08-01 Shrenik Zinage , Sudeepta Mondal , Soumalya Sarkar

Microbial Fuel Cells (MFCs) offer a promising pathway for sustainable energy generation by converting organic matter into electricity through microbial processes. A key factor influencing MFC performance is the anode structure, where design…

Artificial Intelligence · Computer Science 2025-11-19 Mohammad Reza Shafie , Morteza Hajiabadi , Hamed Khosravi , Mobina Noori , Imtiaz Ahmed

Score prediction is crucial in evaluating realistic image sharpness based on collected informative features. Recently, Kolmogorov-Arnold networks (KANs) have been developed and witnessed remarkable success in data fitting. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaode Yu , Ze Chen , Zhimu Yang , Jiacheng Gu , Bizu Feng

Kolmogorov-Arnold Networks (KANs) represent an innovation in neural network architectures, offering a compelling alternative to Multi-Layer Perceptrons (MLPs) in models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks…

Machine Learning · Computer Science 2025-02-12 Hoang-Thang Ta , Duy-Quy Thai , Anh Tran , Grigori Sidorov , Alexander Gelbukh

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Kolmogorov-Arnold Networks (KANs) require significantly smaller architectures compared to multilayer perceptron (MLP)-based approaches, while retaining expressive power through spline-based activations. Moving boundary problems are…

Mathematical Physics · Physics 2026-02-10 Tarus Pande , V M S K Minnikanti , Shyamprasad Karagadde

Machine learning for scientific discovery is increasingly becoming popular because of its ability to extract and recognize the nonlinear characteristics from the data. The black-box nature of deep learning methods poses difficulties in…

Computational Physics · Physics 2024-11-19 Ashish Pal , Satish Nagarajaiah

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Atmospheric correction is a critical preprocessing step in optical remote sensing, but repeated high-fidelity radiative transfer simulations remain computationally expensive for dense look-up-table generation, sensitivity analysis,…

Atmospheric and Oceanic Physics · Physics 2026-05-13 Md Abdullah Al Mazid , Naphtali Rishe

Transformers stand as the cornerstone of mordern deep learning. Traditionally, these models rely on multi-layer perceptron (MLP) layers to mix the information between channels. In this paper, we introduce the Kolmogorov-Arnold Transformer…

Machine Learning · Computer Science 2024-09-18 Xingyi Yang , Xinchao Wang

We introduce a novel symbolic regression framework, namely KAN-SR, built on Kolmogorov Arnold Networks (KANs) which follows a divide-and-conquer approach. Symbolic regression searches for mathematical equations that best fit a given dataset…

Machine Learning · Computer Science 2025-09-15 Marco Andrea Bühler , Gonzalo Guillén-Gosálbez

To address the challenge of tractability for optimizing mathematical models in science and engineering, surrogate models are often employed. Recently, a new class of machine learning models named Kolmogorov Arnold Networks (KANs) have been…

Optimization and Control · Mathematics 2025-03-05 Tanuj Karia , Giacomo Lastrucci , Artur M. Schweidtmann