English
Related papers

Related papers: Orthogonal Least Squares Algorithm for the Approxi…

200 papers

In the paper we consider the problem of multivariate function approximation in polynomial basis. In order to solve this problem, we adjust the least squares method (LSM) by adding information about derivatives of the function. This…

Numerical Analysis · Mathematics 2018-02-06 Gleb Ryzhakov , Ivan Oseledets

Existing methods for out-of-distribution (OOD) detection use various techniques to produce a score, separate from classification, that determines how ``OOD'' an input is. Our insight is that OOD detection can be simplified by using a neural…

Machine Learning · Computer Science 2025-01-07 Amol Khanna , Chenyi Ling , Derek Everett , Edward Raff , Nathan Inkawhich

Recently, collocation based radial basis function (RBF) partition of unity methods (PUM) for solving partial differential equations have been formulated and investigated numerically and theoretically. When combined with stable evaluation…

Numerical Analysis · Mathematics 2017-02-24 Elisabeth Larsson , Victor Shcherbakov , Alfa Heryudono

Approximation of scattered data is often a task in many engineering problems. The Radial Basis Function (RBF) approximation is appropriate for big scattered datasets in $n-$dimensional space. It is a non-separable approximation, as it is…

Computational Engineering, Finance, and Science · Computer Science 2018-06-22 Zuzana Majdisova , Vaclav Skala

In computational practice, most attention is paid to rational approximations of functions and approximations by the sum of exponents. We consider a wide enough class of nonlinear approximations characterized by a set of two required…

Numerical Analysis · Mathematics 2023-01-18 Petr N. Vabishchevich

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

Machine Learning · Computer Science 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

Machine learning has been successfully applied to various fields of scientific computing in recent years. In this work, we propose a sparse radial basis function neural network method to solve elliptic partial differential equations (PDEs)…

Numerical Analysis · Mathematics 2023-09-07 Zhiwen Wang , Minxin Chen , Jingrun Chen

This paper proposes fractional order graph neural networks (FGNNs), optimized by the approximation strategy to address the challenges of local optimum of classic and fractional graph neural networks which are specialised at aggregating…

Machine Learning · Computer Science 2021-07-07 Zijian Liu , Chunbo Luo , Shuai Li , Peng Ren , Geyong Min

Developing efficient methods for solving parametric partial differential equations is crucial for addressing inverse problems. This work introduces a Least-Squares-based Neural Network (LS-Net) method for solving linear parametric PDEs. It…

Numerical Analysis · Mathematics 2025-02-13 Shima Baharlouei , Jamie M. Taylor , Carlos Uriarte , David Pardo

This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much…

Computer Vision and Pattern Recognition · Computer Science 2014-04-29 Can-Yi Lu , Hai Min , Zhong-Qiu Zhao , Lin Zhu , De-Shuang Huang , Shuicheng Yan

We propose an online learning algorithm for a class of machine learning models under a separable stochastic approximation framework. The essence of our idea lies in the observation that certain parameters in the models are easier to…

Machine Learning · Computer Science 2023-05-23 Min Gan , Xiang-xiang Su , Guang-yong Chen , Jing Chen

This paper proposes a Direct Rational Radial Basis Functions Partition of Unity (D-RRBF-PU) approach to compute derivatives of functions with steep gradients or discontinuities. The novelty of the method concerns how derivatives are…

Numerical Analysis · Mathematics 2025-01-13 Vahid Mohammadi , Stefano De Marchi

Random Fourier features (RFF) represent one of the most popular and wide-spread techniques in machine learning to scale up kernel algorithms. Despite the numerous successful applications of RFFs, unfortunately, quite little is understood…

Machine Learning · Statistics 2019-02-12 Zoltan Szabo , Bharath K. Sriperumbudur

Partial differential equations (PDEs) on surfaces appear in many applications throughout the natural and applied sciences. The classical closest point method (Ruuth and Merriman, J. Comput. Phys. 227(3):1943-1961, [2008]) is an embedding…

Numerical Analysis · Mathematics 2018-05-17 Argyrios Petras , Leevan Ling , Steven J. Ruuth

Herein, we propose a spatio-temporal extension of RBFNN for nonlinear system identification problem. The proposed algorithm employs the concept of time-space orthogonality and separately models the dynamics and nonlinear complexities of the…

Machine Learning · Statistics 2019-08-06 Shujaat Khan , Jawwad Ahmad , Alishba Sadiq , Imran Naseem , Muhammad Moinuddin

We propose a differential radial basis function (RBF) network termed RBF-DiffNet -- whose hidden layer blocks are partial differential equations (PDEs) linear in terms of the RBF -- to make the baseline RBF network robust to noise in…

Machine Learning · Computer Science 2020-10-14 Kojo Sarfo Gyamfi , James Brusey , Elena Gaura

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

This paper presented a face detection system using Radial Basis Function Neural Networks With Fixed Spread Value. Face detection is the first step in face recognition system. The purpose is to localize and extract the face region from the…

Computer Vision and Pattern Recognition · Computer Science 2014-10-09 K. A. A. Aziz , S. S. Abdullah

Orthogonal drawings, i.e., embeddings of graphs into grids, are a classic topic in Graph Drawing. Often the goal is to find a drawing that minimizes the number of bends on the edges. A key ingredient for bend minimization algorithms is the…

Computational Geometry · Computer Science 2019-03-13 Benjamin Niedermann , Ignaz Rutter , Matthias Wolf

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova