English
Related papers

Related papers: KAN v.s. MLP for Offline Reinforcement Learning

200 papers

Kolmogorov-Arnold Networks or KANs have shown the ability to outperform classical Deep Neural Networks, while using far fewer trainable parameters for regression problems on scientific domains. Even more powerful has been their…

Data science has emerged as fourth paradigm of scientific exploration. However many machine learning models operate as black boxes offering limited insight into the reasoning behind their predictions. This lack of transparency is one of the…

Machine Learning · Computer Science 2025-01-31 Sudhanva Kulkarni

Multivariate time series forecasting is a crucial task that predicts the future states based on historical inputs. Related techniques have been developing in parallel with the machine learning community, from early statistical learning…

Machine Learning · Computer Science 2025-02-12 Xiao Han , Xinfeng Zhang , Yiling Wu , Zhenduo Zhang , Zhe Wu

The Kolmogorov-Arnold Network (KAN) is a novel multi-layer network model recognized for its efficiency in neuromorphic computing, where synapses between neurons are trained linearly. Computations in KAN are performed by generating a…

Quantum Physics · Physics 2025-12-19 Hikaru Wakaura , Rahmat Mulyawan , Andriyan B. Suksmono

Continual learning requires models to train continuously across consecutive tasks without forgetting. Most existing methods utilize linear classifiers, which struggle to maintain a stable classification space while learning new tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yusong Hu , Zichen Liang , Fei Yang , Qibin Hou , Xialei Liu , Ming-Ming Cheng

Kolmogorov-Arnold Networks (KANs) have seen great success in scientific domains thanks to spline activation functions, becoming an alternative to Multi-Layer Perceptrons (MLPs). However, spline functions may not respect symmetry in tasks,…

Machine Learning · Computer Science 2025-08-18 Lexiang Hu , Yisen Wang , Zhouchen Lin

Tabular data analysis presents unique challenges that arise from heterogeneous feature types, missing values, and complex feature interactions. While traditional machine learning methods like gradient boosting often outperform deep…

Machine Learning · Computer Science 2025-12-10 Ali Eslamian , Alireza Afzal Aghaei , Qiang Cheng

Kolmogorov-Arnold Networks (KANs) uniquely combine high accuracy with interpretability, making them valuable for scientific modeling. However, it is unclear a priori how deep a network needs to be for any given task, and deeper KANs can be…

Machine Learning · Computer Science 2025-08-22 James Bagrow , Josh Bongard

Recent work has established an alternative to traditional multi-layer perceptron neural networks in the form of Kolmogorov-Arnold Networks (KAN). The general KAN framework uses learnable activation functions on the edges of the…

Machine Learning · Computer Science 2025-01-28 Eric A. F. Reinhardt , P. R. Dinesh , Sergei Gleyzer

Kolmogorov Arnold Networks (KANs), built upon the Kolmogorov Arnold representation theorem (KAR), have demonstrated promising capabilities in expressing complex functions with fewer neurons. This is achieved by implementing learnable…

The domain of laser fusion presents a unique and challenging predictive modeling application landscape for machine learning methods due to high problem complexity and limited training data. Data-driven approaches utilizing prescribed…

Machine Learning · Computer Science 2024-09-16 Rahman Ejaz , Varchas Gopalaswamy , Riccardo Betti , Aarne Lees , Christopher Kanan

This paper compares Kolmogorov-Arnold Networks (KAN) and Long Short-Term Memory networks (LSTM) for forecasting non-deterministic stock price data, evaluating predictive accuracy versus interpretability trade-offs using Root Mean Square…

Machine Learning · Computer Science 2025-11-25 Tabish Ali Rather , S M Mahmudul Hasan Joy , Nadezda Sukhorukova , Federico Frascoli

Time series forecasting has long been a focus of research across diverse fields, including economics, energy, healthcare, and traffic management. Recent works have introduced innovative architectures for time series models, such as the…

Machine Learning · Computer Science 2025-03-28 Young-Chae Hong , Bei Xiao , Yangho Chen

Non-Terrestrial Networks (NTNs) are becoming a critical component of modern communication infrastructures, especially with the advent of Low Earth Orbit (LEO) satellite systems. Traditional centralized learning approaches face major…

Networking and Internet Architecture · Computer Science 2025-03-04 Engin Zeydan , Cristian J. Vaca-Rubio , Luis Blanco , Roberto Pereira , Marius Caus , Kapal Dev

The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional…

Hardware Architecture · Computer Science 2025-04-15 Dhruv Kulkarni , Bharat Bhammar , Henil Thaker , Pranav Dhobi , R. P. Gohil , Sai Manoj Pudukotai Dinkarrao

We develop a method for multifidelity Kolmogorov-Arnold networks (KANs), which use a low-fidelity model along with a small amount of high-fidelity data to train a model for the high-fidelity data accurately. Multifidelity KANs (MFKANs)…

Machine Learning · Computer Science 2024-10-22 Amanda A. Howard , Bruno Jacob , Panos Stinis

While most modern machine learning methods offer speed and accuracy, few promise interpretability or explainability -- two key features necessary for highly sensitive industries, like medicine, finance, and engineering. Using eight datasets…

Machine Learning · Computer Science 2025-04-08 Nataly R. Panczyk , Omer F. Erdem , Majdi I. Radaideh

Limited by the complexity of basis function (B-spline) calculations, Kolmogorov-Arnold Networks (KAN) suffer from restricted parallel computing capability on GPUs. This paper proposes a novel ReLU-KAN implementation that inherits the core…

Machine Learning · Computer Science 2024-08-13 Qi Qiu , Tao Zhu , Helin Gong , Liming Chen , Huansheng Ning

This paper presents, for the first time, a framework for Kolmogorov-Arnold Networks (KANs) in power system applications. Inspired by the recently proposed KAN architecture, this paper proposes physics-informed Kolmogorov-Arnold Networks…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Hang Shuai , Fangxing Li

The highly nonlinear degradation process, complex physical interactions, and various sources of uncertainty render single-image Super-resolution (SR) a particularly challenging task. Existing interpretable SR approaches, whether based on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Jocelyn Chanussot