English
Related papers

Related papers: Function Fitting Based on Kolmogorov-Arnold Theore…

200 papers

Computing low-rank approximations of kernel matrices is an important problem with many applications in scientific computing and data science. We propose methods to efficiently approximate and store low-rank approximations to kernel matrices…

Numerical Analysis · Mathematics 2025-03-14 Abraham Khan , Arvind K. Saibaba

In the multivariate regression, also referred to as multi-task learning in machine learning, the goal is to recover a vector-valued function based on noisy observations. The vector-valued function is often assumed to be of low rank.…

Statistics Theory · Mathematics 2020-05-05 Wenjia Wang , Yi-Hui Zhou

Multiple kernel learning (MKL) aims to find an optimal, consistent kernel function. In the hierarchical multiple kernel clustering (HMKC) algorithm, sample features are extracted layer by layer from a high-dimensional space to maximize the…

Machine Learning · Computer Science 2024-10-29 Lei Wang , Liang Du , Peng Zhou

Photonic neural networks promise ultrafast inference, yet most architectures rely on linear optical meshes with electronic nonlinearities, reintroducing optical-electrical-optical bottlenecks. Here we introduce small-scale photonic…

Multi-kernel learning (MKL) exhibits well-documented performance in online non-linear function approximation. Federated learning enables a group of learners (called clients) to train an MKL model on the data distributed among clients to…

Machine Learning · Computer Science 2023-11-10 Pouya M. Ghari , Yanning Shen

We present a unified theoretical and computational framework for constructing reproducing kernels tailored to transport equations and adapted to Koopman eigenfunctions of nonlinear dynamical systems. These eigenfunctions satisfy a…

Numerical Analysis · Mathematics 2026-03-10 Boumediene Hamzi , Houman Owhadi , Umesh Vaidya

In statistical learning, identifying underlying structures of true target functions based on observed data plays a crucial role to facilitate subsequent modeling and analysis. Unlike most of those existing methods that focus on some…

Machine Learning · Statistics 2021-05-04 Xin He , Yeheng Ge , Xingdong Feng

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and…

Machine Learning · Computer Science 2024-05-28 Moein E. Samadi , Younes Müller , Andreas Schuppert

This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent…

Numerical Analysis · Mathematics 2022-10-31 Gabriele Santin , Bernard Haasdonk

Kernel adaptive filtering (KAF) integrates traditional linear algorithms with kernel methods to generate nonlinear solutions in the input space. The standard approach relies on the representer theorem and the kernel trick to perform…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Kan Li , Jose C. Principe

A computationally efficient protocol for machine learning in chemical space using Boltzmann ensembles of conformers as input is proposed; the method is based on rewriting Kernel Ridge Regression expressions in terms of Structured Orthogonal…

Chemical Physics · Physics 2025-07-11 Konstantin Karandashev

Kolmogorov-Arnold Networks (KAN) models were recently proposed and claimed to provide improved parameter scaling and interpretability compared to conventional multilayer perceptron (MLP) models. Inspired by the KAN architecture, we propose…

As key models in geometric deep learning, graph neural networks have demonstrated enormous power in molecular data analysis. Recently, a specially-designed learning scheme, known as Kolmogorov-Arnold Network (KAN), shows unique potential…

Machine Learning · Computer Science 2024-12-19 Longlong Li , Yipeng Zhang , Guanghui Wang , Kelin Xia

Handling incomplete and heterogeneous data remains a central challenge in real-world machine learning, where missing values may follow complex mechanisms (MCAR, MAR, MNAR) and features can be of mixed types (numerical and categorical).…

Machine Learning · Computer Science 2025-07-30 Youran Zhou , Mohamed Reda Bouadjenek , Jonathan Wells , Sunil Aryal

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

This paper investigates the estimation of the self-similarity parameter in fractional processes. We re-examine the Kolmogorov-Smirnov (KS) test as a distribution-based method for assessing self-similarity, emphasizing its robustness and…

Methodology · Statistics 2025-02-12 Daniele Angelini , Sergio Bianchi

Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful alternative to traditional multilayer perceptrons. However, their reliance on predefined, bounded grids restricts their ability to approximate functions on unbounded…

Machine Learning · Computer Science 2025-10-10 Alireza Moradzadeh , Srimukh Prasad Veccham , Lukasz Wawrzyniak , Miles Macklin , Saee G. Paliwal

Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-layer Perceptrons (MLPs) due to their superior function-fitting abilities in data-driven modeling. In this paper, we propose a novel framework, DAE-KAN, for…

Machine Learning · Computer Science 2025-04-24 Kai Luo , Juan Tang , Mingchao Cai , Xiaoqing Zeng , Manqi Xie , Ming Yan

Semantic segmentation of structural defects in civil infrastructure remains challenging due to variable defect appearances, harsh imaging conditions, and significant class imbalance. Current deep learning methods, despite their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Steven Sloan , Kendall N. Niles , Ken Pathak

Recent advances in representation learning reveal that widely used objectives, such as contrastive and non-contrastive, implicitly perform spectral decomposition of a contextual kernel, induced by the relationship between inputs and their…

Machine Learning · Computer Science 2025-10-29 Burak Varıcı , Che-Ping Tsai , Ritabrata Ray , Nicholas M. Boffi , Pradeep Ravikumar