English
Related papers

Related papers: A Novel Adaptive Kernel for the RBF Neural Network…

200 papers

In this paper, we develop an approach to exploiting kernel methods with manifold-valued data. In many computer vision problems, the data can be naturally represented as points on a Riemannian manifold. Due to the non-Euclidean geometry of…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Sadeep Jayasumana , Richard Hartley , Mathieu Salzmann , Hongdong Li , Mehrtash Harandi

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Composite adaptive radial basis function neural network (RBFNN) control with a lattice distribution of hidden nodes has three inherent demerits: 1) the approximation domain of adaptive RBFNNs is difficult to be determined a priori; 2) only…

Systems and Control · Electrical Eng. & Systems 2021-04-23 Qiong Liu , Dongyu Li , Shuzhi Sam Ge , Zhong Ouyang

The design of activation functions is a growing research area in the field of neural networks. In particular, instead of using fixed point-wise functions (e.g., the rectified linear unit), several authors have proposed ways of learning…

Machine Learning · Computer Science 2019-01-30 Simone Scardapane , Elena Nieddu , Donatella Firmani , Paolo Merialdo

State estimation is a key ingredient in most robotic systems. Often, state estimation is performed using some form of least squares minimization. Basically, all error minimization procedures that work on real-world data use robust kernels…

Robotics · Computer Science 2021-02-19 Nived Chebrolu , Thomas Läbe , Olga Vysotska , Jens Behley , Cyrill Stachniss

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

In this paper, we propose a special fusion method for combining ensembles of base classifiers utilizing new neural networks in order to improve overall efficiency of classification. While ensembles are designed such that each classifier is…

Machine Learning · Computer Science 2009-12-08 Mehdi Salkhordeh Haghighi , Hadi Sadoghi Yazdi , Abedin Vahedian , Hamed Modaghegh

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A…

Machine Learning · Statistics 2026-05-22 Roberto Cavoretto , Alessandra De Rossi , Adeeba Haider , Amir Noorizadegan

Radial basis function (RBF) network is a third layered neural network that is widely used in function approximation and data classification. Here we propose a quantum model of the RBF network. Similar to the classical case, we still use the…

Quantum Physics · Physics 2020-11-04 Changpeng Shao

Consider the problem: given the data pair $(\mathbf{x}, \mathbf{y})$ drawn from a population with $f_*(x) = \mathbf{E}[\mathbf{y} | \mathbf{x} = x]$, specify a neural network model and run gradient flow on the weights over time until…

Machine Learning · Statistics 2020-07-27 Xialiang Dou , Tengyuan Liang

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Physics-informed deep learning has emerged as a promising alternative for solving partial differential equations. However, for complex problems, training these networks can still be challenging, often resulting in unsatisfactory accuracy…

Machine Learning · Computer Science 2025-09-18 Wenqian Chen , Amanda A. Howard , Panos Stinis

We describe and test numerically an adaptive meshless generalized finite difference method based on radial basis functions that competes well with the finite element method on standard benchmark problems with reentrant corners of the…

Numerical Analysis · Mathematics 2025-08-26 Dang Thi Oanh , Oleg Davydov , Hoang Xuan Phu

Convolutional neural networks (CNNs) have demonstrated their capability to solve different kind of problems in a very huge number of applications. However, CNNs are limited for their computational and storage requirements. These limitations…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Adrià Ciurana , Albert Mosella-Montoro , Javier Ruiz-Hidalgo

Unlike the conventional kernel adaptive filtering (KAF) approach of using a fixed kernel to define the Reproducing Kernel Hilbert Space (RKHS), this paper embeds the statistics of the input data in the kernel definition, obtaining a…

Signal Processing · Electrical Eng. & Systems 2025-10-21 Benjamin Colburn , Luis G. Sanchez Giraldo , Kan Li , Jose C. Principe

Kernel adaptive filtering (KAF) integrates traditional linear algorithms with kernel methods to generate nonlinear solutions in the input space. The standard approach relies on the representer theorem and the kernel trick to perform…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Kan Li , Jose C. Principe

We present Neural Kernel Fields: a novel method for reconstructing implicit 3D shapes based on a learned kernel ridge regression. Our technique achieves state-of-the-art results when reconstructing 3D objects and large scenes from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Francis Williams , Zan Gojcic , Sameh Khamis , Denis Zorin , Joan Bruna , Sanja Fidler , Or Litany

While pseudospectral (PS) methods can feature very high accuracy, they tend to be severely limited in terms of geometric flexibility. Application of global radial basis functions overcomes this, however at the expense of problematic…

Numerical Analysis · Mathematics 2017-05-09 Pankaj K Mishra , Sankar K Nath , Gregor Kosec , Mrinal K Sen

Constrained radial basis function (RBF) regression has recently emerged as a powerful meshless tool for reconstructing continuous velocity fields from scattered flow measurements, particularly in image-based velocimetry. However, existing…

Fluid Dynamics · Physics 2026-03-27 Damien Rigutto , Manuel Ratz , Miguel A. Mendez

In deep learning models, learning more with less data is becoming more important. This paper explores how neural networks with normalized Radial Basis Function (RBF) kernels can be trained to achieve better sample efficiency. Moreover, we…