English
Related papers

Related papers: Monte Carlo Gradient in Optimization Constrained b…

200 papers

Minimax optimization problems have attracted significant attention in recent years due to their widespread application in numerous machine learning models. To solve the minimax problem, a wide variety of stochastic optimization methods have…

Machine Learning · Computer Science 2024-06-12 Hongchang Gao

First of all, this paper presents some improvements of DSMC method in the form of new schemes and approaches, that, for a wide class of problems, increase performance and reduce the demands on computer resources. The most important…

Fluid Dynamics · Physics 2012-01-16 Roman V. Maltsev

Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different…

Mathematical Finance · Quantitative Finance 2023-01-10 Michael B. Giles , Abdul-Lateef Haji-Ali

Recommender systems need to mirror the complexity of the environment they are applied in. The more we know about what might benefit the user, the more objectives the recommender system has. In addition there may be multiple stakeholders -…

Information Retrieval · Computer Science 2020-04-20 Nikola Milojkovic , Diego Antognini , Giancarlo Bergamin , Boi Faltings , Claudiu Musat

The computational complexity of naive, sampling-based uncertainty quantification for 3D partial differential equations is extremely high. Multilevel approaches, such as multilevel Monte Carlo (MLMC), can reduce the complexity significantly,…

Computational Engineering, Finance, and Science · Computer Science 2016-07-13 Björn Gmeiner , Daniel Drzisga , Ulrich Ruede , Robert Scheichl , Barbara Wohlmuth

We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals…

Numerical Analysis · Mathematics 2024-01-23 Petr Karnakov , Sergey Litvinov , Petros Koumoutsakos

In this paper, we propose a tensor type of discretization and optimization process for solving high dimensional partial differential equations. First, we design the tensor type of trial function for the high dimensional partial differential…

Numerical Analysis · Mathematics 2022-12-01 Yangfei Liao , Yifan Wang , Hehu Xie

Bayesian statistical inverse problems are often solved with Markov chain Monte Carlo (MCMC)-type schemes. When the problems are governed by large-scale discrete nonlinear partial differential equations (PDEs), they are computationally…

Numerical Analysis · Mathematics 2019-09-06 Howard C. Elman , Akwum Onwunta

The Monte Carlo method is a thriving and mathematically beautiful numerical technique used extensively, nowadays, to deal with many demanding problems in diverse fields. Here, we present an iterative Monte Carlo algorithm to work out very…

Computational Physics · Physics 2024-08-02 Martín Chávez-Páez , Enrique González-Tovar , Guillermo Iván Guerrero-García

We propose a first-order method for solving inequality constrained optimization problems. The method is derived from our previous work [12], a modified search direction method (MSDM) that applies the singular-value decomposition of…

Optimization and Control · Mathematics 2020-03-12 Long Chen , Wenyi Chen , Kai-Uwe Bletzinger

Optimizing or sampling complex cost functions of combinatorial optimization problems is a longstanding challenge across disciplines and applications. When employing family of conventional algorithms based on Markov Chain Monte Carlo (MCMC)…

Machine Learning · Computer Science 2025-08-15 Dmitrii Dobrynin , Masoud Mohseni , John Paul Strachan

In this paper we propose and analyze two dual methods based on inexact gradient information and averaging that generate approximate primal solutions for smooth convex optimization problems. The complicating constraints are moved into the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

Optimization and Control · Mathematics 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

Ill-posed linear inverse problems arise frequently in various applications, from computational photography to medical imaging. A recent line of research exploits Bayesian inference with informative priors to handle the ill-posedness of such…

Machine Learning · Statistics 2023-10-27 Gabriel Cardoso , Yazid Janati El Idrissi , Sylvain Le Corff , Eric Moulines

We are concerned with the numerical resolution of backward stochastic differential equations. We propose a new numerical scheme based on iterative regressions on function bases, which coefficients are evaluated using Monte Carlo…

Probability · Mathematics 2007-05-23 Emmanuel Gobet , Jean-Philippe Lemor , Xavier Warin

This work demonstrates algorithms to accurately compute solutions to thermal radiation transport problems using a reduced floating-point precision implementation of the Implicit Monte Carlo method. Several techniques falling into the…

Computational Physics · Physics 2025-10-27 Simon Butson , Mathew Cleveland , Alex Long , Todd Palmer

Stochastic Differential Equations (SDEs) are used as statistical models in many disciplines. However, intractable likelihood functions for SDEs make inference challenging, and we need to resort to simulation-based techniques to estimate and…

Methodology · Statistics 2014-08-12 Grant Schneider , Peter F. Craigmile , Radu Herbei

Advanced algorithms are necessary to obtain faster-than-real-time dynamic simulations in a number of different physical problems that are characterized by widely disparate time scales. Recent advanced dynamic Monte Carlo algorithms that…

Materials Science · Physics 2016-11-23 M. A. Novotny

Reinforcement learning (RL) is a promising method to solve control problems. However, model-free RL algorithms are sample inefficient and require thousands if not millions of samples to learn optimal control policies. A major source of…

Machine Learning · Computer Science 2022-10-31 Atish Dixit , Ahmed Elsheikh

We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random…

Numerical Analysis · Mathematics 2023-04-28 Takashi Goda , Wataru Kitade