English
Related papers

Related papers: A Variance Reduction Method for Parametrized Stoch…

200 papers

In this work, we propose a novel model order reduction approach for two-phase flow in porous media by introducing a formulation in which the mobility, which realizes the coupling between phase saturations and phase pressures, is regarded as…

Numerical Analysis · Mathematics 2014-05-13 Sven Kaulmann , Bernd Flemisch , Bernard Haasdonk , Knut-Andreas Lie , Mario Ohlberger

The main focus of this article is to provide a mathematical study of the algorithm proposed in \cite{boyaval2010variance} where the authors proposed a variance reduction technique for the computation of parameter-dependent expectations…

Numerical Analysis · Mathematics 2021-09-24 Mohamed-Raed Blel , Virginie Ehrlacher , Tony Lelièvre

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

Numerical Analysis · Mathematics 2012-05-14 David F. Anderson

In this paper, a computational resources-aware parameter adaptation method for visual-inertial navigation systems is proposed with the goal of enabling the improved deployment of such algorithms on computationally constrained systems. Such…

Robotics · Computer Science 2021-06-02 Pranay Mathur , Nikhil Khedekar , Kostas Alexis

The Reduced Basis Method (RBM) is a popular certified model reduction approach for solving parametrized partial differential equations. One critical stage of the \textit{offline} portion of the algorithm is a greedy algorithm, requiring…

Numerical Analysis · Mathematics 2017-03-17 Jiahua Jiang , Yanlai Chen , Akil Narayan

We propose a randomized a posteriori error estimator for reduced order approximations of parametrized (partial) differential equations. The error estimator has several important properties: the effectivity is close to unity with prescribed…

Numerical Analysis · Mathematics 2019-04-02 Kathrin Smetana , Olivier Zahm , Anthony T Patera

We derive a novel variational expectation maximization approach based on truncated posterior distributions. Truncated distributions are proportional to exact posteriors within subsets of a discrete state space and equal zero otherwise. The…

Machine Learning · Statistics 2019-07-12 Jörg Lücke

(Mini-batch) Stochastic Gradient Descent is a popular optimization method which has been applied to many machine learning applications. But a rather high variance introduced by the stochastic gradient in each step may slow down the…

Machine Learning · Computer Science 2018-10-09 Jingchang Liu , Linli Xu

Stochastic gradient-based optimisation for discrete latent variable models is challenging due to the high variance of gradients. We introduce a variance reduction technique for score function estimators that makes use of double control…

Machine Learning · Statistics 2022-06-07 Michalis K. Titsias , Jiaxin Shi

We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly…

Machine Learning · Statistics 2013-01-08 David Wingate , Theophane Weber

The problem of synthesizing stochastic explicit model predictive control policies is known to be quickly intractable even for systems of modest complexity when using classical control-theoretic methods. To address this challenge, we present…

Machine Learning · Computer Science 2022-05-24 Ján Drgoňa , Sayak Mukherjee , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

We consider the problem of training machine learning models on distributed data in a decentralized way. For finite-sum problems, fast single-machine algorithms for large datasets rely on stochastic updates combined with variance reduction.…

Optimization and Control · Mathematics 2020-06-26 Hadrien Hendrikx , Francis Bach , Laurent Massoulié

We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis…

Statistical Mechanics · Physics 2021-01-14 Avishek Das , David T. Limmer

A large-scale complex system comprising many, often spatially distributed, dynamical subsystems with partial autonomy and complex interactions are called system of systems. This paper describes an efficient algorithm for model predictive…

Optimization and Control · Mathematics 2019-04-25 Branimir Novoselnik , Vedrana Spudić , Mato Baotić

This paper presents a Newton-based stochastic extremum-seeking control method for real-time optimization in multi-input systems with distinct input delays. It combines predictor-based feedback and Hessian inverse estimation via stochastic…

Optimization and Control · Mathematics 2025-02-04 Paulo Cesar Souza Silva , Paulo Cesar Pellanda , Tiago Roux Oliveira

We estimate the parameter of a stationary time series process by minimizing the integrated weighted mean squared error between the empirical and simulated characteristic function, when the true characteristic functions cannot be explicitly…

Statistics Theory · Mathematics 2021-02-03 Richard A. Davis , Thiago do Rêgo Sousa , Claudia Klüppelberg

In this paper, we consider a stochastic Model Predictive Control able to account for effects of additive stochastic disturbance with unbounded support, and requiring no restrictive assumption on either independence nor Gaussianity. We…

Systems and Control · Electrical Eng. & Systems 2020-03-17 Martina Mammarella , Teodoro Alamo , Sergio Lucia , Fabrizio Dabbene

This paper considers the problem of minimizing a convex expectation function with a set of inequality convex expectation constraints. We present a computable stochastic approximation type algorithm, namely the stochastic linearized proximal…

Optimization and Control · Mathematics 2022-06-16 Liwei Zhang , Yule Zhang , Jia Wu , Xiantao Xiao

This paper focuses on stochastic optimal control problems with constraints in law, which are rewritten as optimization (minimization) of probability measures problem on the canonical space. We introduce a penalized version of this type of…

Optimization and Control · Mathematics 2025-03-18 Thibaut Bourdais , Nadia Oudjane , Francesco Russo

Model predictive control (MPC) schemes have a proven track record for delivering aggressive and robust performance in many challenging control tasks, coping with nonlinear system dynamics, constraints, and observational noise. Despite their…

Robotics · Computer Science 2024-01-24 Lucas Barcelos , Alexander Lambert , Rafael Oliveira , Paulo Borges , Byron Boots , Fabio Ramos