English
Related papers

Related papers: Optimal Transport Based Filtering with Nonlinear S…

200 papers

Particle filtering is a Bayesian inference method and a fundamental tool in state estimation for dynamic systems, but its effectiveness is often limited by the constraints of the initial prior distribution, a phenomenon we define as the…

Machine Learning · Statistics 2025-01-31 Yiwei Shi , Jingyu Hu , Yu Zhang , Mengyue Yang , Weinan Zhang , Cunjia Liu , Weiru Liu

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

The classical problem of optimal transportation can be formulated as a linear optimization problem on a convex domain: among all joint measures with fixed marginals find the optimal one, where optimality is measured against a cost function.…

Optimization and Control · Mathematics 2012-11-29 Jonathan Korman , Robert J. McCann

Recently, Optimal Transport has been proposed as a probabilistic framework in Machine Learning for comparing and manipulating probability distributions. This is rooted in its rich history and theory, and has offered new solutions to…

Machine Learning · Computer Science 2024-08-22 Eduardo Fernandes Montesuma , Fred Ngolè Mboula , Antoine Souloumiac

We present a new transport-based approach to efficiently perform sequential Bayesian inference of static model parameters. The strategy is based on the extraction of conditional distribution from the joint distribution of parameters and…

Methodology · Statistics 2023-08-29 Paul-Baptiste Rubio , Youssef Marzouk , Matthew Parno

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito

We study multi-marginal optimal transport problems from a probabilistic graphical model perspective. We point out an elegant connection between the two when the underlying cost for optimal transport allows a graph structure. In particular,…

Optimization and Control · Mathematics 2020-06-26 Isabel Haasler , Rahul Singh , Qinsheng Zhang , Johan Karlsson , Yongxin Chen

We consider approximate maximum likelihood parameter estimation in nonlinear state-space models. We discuss both direct optimization of the likelihood and expectation--maximization (EM). For EM, we also give closed-form expressions for the…

Methodology · Statistics 2015-11-03 Juho Kokkala , Arno Solin , Simo Särkkä

Smoothers are algorithms for Bayesian time series re-analysis. Most operational smoothers rely either on affine Kalman-type transformations or on sequential importance sampling. These strategies occupy opposite ends of a spectrum that…

Methodology · Statistics 2023-11-23 Maximilian Ramgraber , Ricardo Baptista , Dennis McLaughlin , Youssef Marzouk

This survey paper is written with the intention of giving a mathematical introduction to filtering techniques for intermittent data assimilation, and to survey some recent advances in the field. The paper is divided into three parts. The…

Numerical Analysis · Mathematics 2012-09-03 Colin J. Cotter , Sebastian Reich

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

Given samples from two joint distributions, we consider the problem of Optimal Transportation (OT) between them when conditioned on a common variable. We focus on the general setting where the conditioned variable may be continuous, and the…

Machine Learning · Computer Science 2024-06-12 Piyushi Manupriya , Rachit Keerti Das , Sayantan Biswas , Saketha Nath Jagarlapudi

In this paper, the distributed strongly convex optimization problem is studied with spatio-temporal compressed communication and equality constraints. For the case where each agent holds an distributed local equality constraint, a…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Zihao Ren , Lei Wang , Zhengguang Wu , Guodong Shi

This paper proposes a novel framework for delay-tolerant particle filtering that is computationally efficient and has limited memory requirements. Within this framework the informativeness of a delayed (out-of-sequence) measurement (OOSM)…

Applications · Statistics 2015-05-20 Boris N. Oreshkin , Xuan Liu , Mark J. Coates

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

A new framework for nonlinear system identification is presented in terms of optimal fitting of stable nonlinear state space equations to input/output/state data, with a performance objective defined as a measure of robustness of the…

Optimization and Control · Mathematics 2016-11-17 Mark M. Tobenkin , Ian R. Manchester , Jennifer Wang , Alexandre Megretski , Russ Tedrake

State estimation of dynamical systems is crucial for providing new decision-making and system automation information in different applications. However, the assumptions on the standard computational models for sensor measurements can be…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Aamir Hussain Chughtai , Arslan Majal , Muhammad Tahir , Momin Uppal

Optimal transport (OT) is a powerful framework to compare probability measures, a fundamental task in many statistical and machine learning problems. Substantial advances have been made in designing OT variants which are either…

Machine Learning · Computer Science 2025-02-04 Clément Bonet , Kimia Nadjahi , Thibault Séjourné , Kilian Fatras , Nicolas Courty

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

This article discusses a partially adapted particle filter for estimating the likelihood of a nonlinear structural econometric state space models whose state transition density cannot be expressed in closed form. The filter generates the…

Methodology · Statistics 2012-09-05 Jamie Hall , Michael K. Pitt , Robert Kohn