English
Related papers

Related papers: Orthogonal Least Squares Algorithm for the Approxi…

200 papers

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

We present an algorithm for approximating a function defined over a $d$-dimensional manifold utilizing only noisy function values at locations sampled from the manifold with noise. To produce the approximation we do not require any…

Machine Learning · Statistics 2020-08-13 Barak Sober , Yariv Aizenbud , David Levin

In this work, we study the problem of non-blind image deconvolution and propose a novel recurrent network architecture that leads to very competitive restoration results of high image quality. Motivated by the computational efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Iaroslav Koshelev , Daniil Selikhanovych , Stamatios Lefkimmiatis

OPF problems are formulated and solved for power system operations, especially for determining generation dispatch points in real-time. For large and complex power system networks with large numbers of variables and constraints, finding the…

Systems and Control · Electrical Eng. & Systems 2024-11-12 Thuan Pham , Xingpeng Li

This paper looks to apply the mathematical framework of the Theory of Functional Connections to the solution of boundary-value problems arising from hybrid systems. The Theory of Functional Connections is a technique to derive constrained…

Optimization and Control · Mathematics 2021-03-10 Hunter Johnston , Daniele Mortari

Neural networks (NN) are extensively studied in cutting-edge soft sensor models due to their feature extraction and function approximation capabilities. Current research into network-based methods primarily focuses on models' offline…

Machine Learning · Computer Science 2024-09-25 Shaoqi Wang , Chunjie Yang , Siwei Lou

The purpose of this paper is to introduce a very efficient algorithm for signal extrapolation. It can widely be used in many applications in image and video communication, e. g. for concealment of block errors caused by transmission errors…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Jürgen Seiler , André Kaup

Nowadays, Non-Linear Least-Squares embodies the foundation of many Robotics and Computer Vision systems. The research community deeply investigated this topic in the last years, and this resulted in the development of several open-source…

Pose-Graph optimization is a crucial component of many modern SLAM systems. Most prominent state of the art systems address this problem by iterative non-linear least squares. Both number of iterations and convergence basin of these…

Robotics · Computer Science 2018-09-05 Irvin Aloise , Giorgio Grisetti

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Radial-basis-function networks are traditionally defined for sets of vector-based observations. In this short paper, we reformulate such networks so that they can be applied to adjacency-matrix representations of weighted, directed graphs…

Machine Learning · Computer Science 2019-08-05 Isaac J. Sledge , Jose C. Principe

A partial least squares regression is proposed for estimating the function-on-function regression model where a functional response and multiple functional predictors consist of random curves with quadratic and interaction effects. The…

Methodology · Statistics 2020-12-11 Ufuk Beyaztas , Han Lin Shang

Almost universally in computer vision, when surface derivatives are required, they are computed using only first order accurate finite difference approximations. We propose a new method for computing numerical derivatives based on 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Dizhong Zhu , William A P Smith

For quasi-linear interface problems with discontinuous diffusion coefficients, the nonconvex objective functional often leads to optimization stagnation in randomized neural network approximations. This paper Proposes a…

Numerical Analysis · Mathematics 2026-02-06 Siyuan Lang , Zhiyue Zhang

Function approximation has been an indispensable component in modern reinforcement learning algorithms designed to tackle problems with large state spaces in high dimensions. This paper reviews recent results on error analysis for these…

Machine Learning · Computer Science 2024-02-27 Jihao Long , Jiequn Han

We propose an algorithm, called OEM (a.k.a. orthogonalizing EM), intended for var- ious least squares problems. The first step, named active orthogonization, orthogonalizes an arbi- trary regression matrix by elaborately adding more rows.…

Computation · Statistics 2013-08-16 Shifeng Xiong , Bin Dai , Peter Z. G. Qian

This work presents a systematic analysis and extension of the sparse radial basis function network (SparseRBFnet) previously introduced for solving nonlinear partial differential equations (PDEs). Based on its adaptive-width shallow kernel…

Numerical Analysis · Mathematics 2026-01-27 Zihan Shao , Konstantin Pieper , Xiaochuan Tian

Trigonometric polynomials are widely used for the approximation of a smooth function $f$ from a set of nonuniformly spaced samples $\{f(x_j)\}_{j=0}^{N-1}$. If the samples are perturbed by noise, controlling the smoothness of the…

Numerical Analysis · Mathematics 2025-10-20 Thomas Strohmer

Fast Field-Cycling Nuclear Magnetic Resonance relaxometry is a non-destructive technique to investigate molecular dynamics and structure of systems having a wide range of applications such as environment, biology, and food. Besides a…

This paper presents a unified Least-Squares framework for solving nonlinear partial differential equations by recasting the governing system as a residual minimisation problem. A Least-Squares functional is formulated and the corresponding…

Numerical Analysis · Mathematics 2025-11-10 Fleurianne Bertrand , Maximilian Brodbeck , Tim Ricken , Henrik Schneider