English
Related papers

Related papers: Improve Unscented Kalman Inversion With Low-Rank A…

200 papers

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they…

Numerical Analysis · Mathematics 2025-01-22 Zhiwei Gao , George Em Karniadakis

In a Bayesian setting, inverse problems and uncertainty quantification (UQ) - the propagation of uncertainty through a computational (forward) model - are strongly connected. In the form of conditional expectation the Bayesian update…

Numerical Analysis · Mathematics 2014-04-09 Alexander Litvinenko , Hermann G. Matthies

This paper addresses the challenge of estimating the orientation, position, and velocity of a vehicle operating in three-dimensional (3D) space with six degrees of freedom (6-DoF). A Deep Learning-based Adaptation Mechanism (DLAM) is…

Robotics · Computer Science 2025-03-13 Khashayar Ghanizadegan , Hashim A. Hashim

Velocity estimation is of great importance in autonomous racing. Still, existing solutions are characterized by limited accuracy, especially in the case of aggressive driving or poor generalization to unseen road conditions. To address…

Robotics · Computer Science 2024-08-29 Jan Węgrzynowski , Grzegorz Czechmanowski , Piotr Kicki , Krzysztof Walas

This paper addresses the problem of designing the {\it continuous-discrete} unscented Kalman filter (UKF) implementation methods. More precisely, the aim is to propose the MATLAB-based UKF algorithms for {\it accurate} and {\it robust}…

Numerical Analysis · Mathematics 2023-10-09 Maria Kulikova , Gennady Kulikov

In this work, we present a new derivative-free optimization method and investigate its use for training neural networks. Our method is motivated by the Ensemble Kalman Filter (EnKF), which has been used successfully for solving optimization…

Numerical Analysis · Mathematics 2018-06-01 Eldad Haber , Felix Lucka , Lars Ruthotto

In this paper, we introduce PSI-LinUCB, a scalable variant of LinUCB that enables efficient training, inference, and memory usage by representing the inverse regularized design matrix as a sum of a diagonal matrix and low-rank correction.…

Machine Learning · Computer Science 2026-02-10 Evgenia Shustova , Marina Sheshukova , Sergey Samsonov , Evgeny Frolov

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

Numerical Analysis · Mathematics 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

Gradient-free/zeroth-order methods for black-box convex optimization have been extensively studied in the last decade with the main focus on oracle calls complexity. In this paper, besides the oracle complexity, we focus also on iteration…

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…

Visual-inertial odometry (VIO) systems traditionally rely on filtering or optimization-based techniques for egomotion estimation. While these methods are accurate under nominal conditions, they are prone to failure during severe…

Robotics · Computer Science 2022-10-04 Brandon Wagstaff , Emmett Wise , Jonathan Kelly

A novel theoretical framework, the inverse problem approach, is proposed to calculate non-perturbative quantities in quantum chromodynamics (QCD). Based on the dispersion relation of quantum field theory, this approach determines unknown…

High Energy Physics - Theory · Physics 2026-05-22 Ao-Sheng Xiong , Fu-Sheng Yu , Yong Zheng , Ting Wei

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

We present a novel algorithm based on the ensemble Kalman filter to solve inverse problems involving multiscale elliptic partial differential equations. Our method is based on numerical homogenization and finite element discretization and…

Numerical Analysis · Mathematics 2020-12-16 Assyr Abdulle , Giacomo Garegnani , Andrea Zanoni

We introduce a practical method for incorporating equality and inequality constraints in global optimization methods based on stochastic interacting particle systems, specifically consensus-based optimization (CBO) and ensemble Kalman…

Optimization and Control · Mathematics 2021-11-05 J. A. Carrillo , C. Totzeck , U. Vaes

An algorithm for a family of self-starting high-order implicit time integration schemes with controllable numerical dissipation is proposed for both linear and nonlinear transient problems. This work builds on the previous works of the…

Numerical Analysis · Mathematics 2024-09-23 Daniel O'Shea , Xiaoran Zhang , Shayan Mohammadian , Chongmin Song

Counter-adversarial system design problems have lately motivated the development of inverse Bayesian filters. For example, inverse Kalman filter (I-KF) has been recently formulated to estimate the adversary's Kalman-filter-tracked estimates…

Optimization and Control · Mathematics 2023-08-11 Himali Singh , Arpan Chattopadhyay , Kumar Vijay Mishra