English
Related papers

Related papers: The Recursive Gauss-Newton Filter

200 papers

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

By chaining a sequence of differentiable invertible transformations, normalizing flows (NF) provide an expressive method of posterior approximation, exact density evaluation, and sampling. The trend in normalizing flow literature has been…

Machine Learning · Computer Science 2020-10-20 Robert Giaquinto , Arindam Banerjee

Within the field of instance segmentation, most of the state-of-the-art deep learning networks rely nowadays on cascade architectures, where multiple object detectors are trained sequentially, re-sampling the ground truth at each step. This…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Leonardo Rossi , Akbar Karimi , Andrea Prati

In the Global Navigation Satellite System (GNSS) context, the growing number of available satellites has lead to many challenges when it comes to choosing the most accurate pseudorange contributions, given the strong impact of biased…

Signal Processing · Electrical Eng. & Systems 2023-06-09 Ibrahim Sbeity , Christophe Villien , Benoît Denis , E. Veronica Belmega

The single-particle Green's function (GF) of mesoscopic structures plays a central role in mesoscopic quantum transport. The recursive GF technique is a standard tool to compute this quantity numerically, but it lacks physical transparency…

Mesoscale and Nanoscale Physics · Physics 2017-02-22 Shu-Hui Zhang , Wen Yang , Kai Chang

Graph Neural Networks (GNNs) have achieved impressive performance in collaborative filtering. However, GNNs tend to yield inferior performance when the distributions of training and test data are not aligned well. Also, training GNNs…

Machine Learning · Computer Science 2023-07-19 Huiyuan Chen , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Junpeng Wang , Vivian Lai , Mahashweta Das , Hao Yang

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

In this paper, we study Newton-conjugate gradient (Newton-CG) methods for minimizing a nonconvex function $f$ whose Hessian is $(H_f,\nu)$-H\"older continuous with modulus $H_f>0$ and exponent $\nu\in(0,1]$. Recently proposed Newton-CG…

Optimization and Control · Mathematics 2026-04-30 Ziyang Zeng , Junyu Zhang , Chuan He

Computational kernel of the three-dimensional variational data assimilation (3D-Var) problem is a linear system, generally solved by means of an iterative method. The most costly part of each iterative step is a matrix-vector product with a…

Numerical Analysis · Computer Science 2014-05-15 S. Cuomo , R. Farina , A. Galletti , L. Marcellino

This work develops a robust diffusion recursive least squares algorithm to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. This algorithm minimizes an exponentially weighted…

Information Theory · Computer Science 2019-02-20 Y. Yu , R. C. de Lamare , Y. Zakharov

This paper presents a new class of adaptive filters, namely Geometric-Algebra Adaptive Filters (GAAFs). They are generated by formulating the underlying minimization problem (a deterministic cost function) from the perspective of Geometric…

Optimization and Control · Mathematics 2018-08-22 Wilder B. Lopes , Cassio G. Lopes

The Gaussian Filter (GF) is one of the most widely used filtering algorithms; instances are the Extended Kalman Filter, the Unscented Kalman Filter and the Divided Difference Filter. GFs represent the belief of the current state by a…

Robotics · Computer Science 2015-06-09 Manuel Wüthrich , Sebastian Trimpe , Daniel Kappler , Stefan Schaal

Collaborative filtering (CF) is a long-standing problem of recommender systems. Many novel methods have been proposed, ranging from classical matrix factorization to recent graph convolutional network-based approaches. After recent fierce…

Information Retrieval · Computer Science 2021-08-19 Jeongwhan Choi , Jinsung Jeon , Noseong Park

Computing the regularized solution of Bayesian linear inverse problems as well as the corresponding regularization parameter is highly desirable in many applications. This paper proposes a novel iterative method, termed the Projected Newton…

Numerical Analysis · Mathematics 2025-04-08 Haibo Li

Logistic regression is a well-known statistical model which is commonly used in the situation where the output is a binary random variable. It has a wide range of applications including machine learning, public health, social sciences,…

Statistics Theory · Mathematics 2019-04-18 Bernard Bercu , Antoine Godichon-Baggioni , Bruno Portier

Gaussian mixtures are a common density representation in nonlinear, non-Gaussian Bayesian state estimation. Selecting an appropriate number of Gaussian components, however, is difficult as one has to trade of computational complexity…

Systems and Control · Computer Science 2012-04-02 Marco F. Huber

Filtering is a general name for inferring the states of a dynamical system given observations. The most common filtering approach is Gaussian Filtering (GF) where the distribution of the inferred states is a Gaussian whose mean is an affine…

Signal Processing · Electrical Eng. & Systems 2018-11-21 Arash Mehrjou , Bernhard Schölkopf

We propose a semismooth Newton-based augmented Lagrangian framework for reconstructing sparse sources in inverse acoustic scattering problems. Rather than working in the unknown source space, our semismooth Newton updates operate in the…

Numerical Analysis · Mathematics 2025-10-29 Nirui Tan , Hongpeng Sun

Recursive estimates of large systems of equations in the context of least squares fitting is a common practice in different fields of study. For example, recursive adaptive filtering is extensively used in signal processing and control…

Numerical Analysis · Mathematics 2018-01-04 Nasser Kazemi , Mauricio Sacchi

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where…

Computation · Statistics 2020-08-13 Sirio Legramanti