English
Related papers

Related papers: Complementary First and Second Derivative Methods …

200 papers

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

Classical algorithms in numerical analysis for numerical integration (quadrature/cubature) follow the principle of approximate and integrate: the integrand is approximated by a simple function (e.g. a polynomial), which is then integrated…

Numerical Analysis · Mathematics 2018-06-15 Yuji Nakatsukasa

Derivative-free optimization (DFO) consists in finding the best value of an objective function without relying on derivatives. To tackle such problems, one may build approximate derivatives, using for instance finite-difference estimates.…

Optimization and Control · Mathematics 2024-06-04 Clément W. Royer , Oumaima Sohab , Luis Nunes Vicente

This study presents a comparative analysis of Monte Carlo (MC) and quasi-Monte Carlo (QMC) methods in the context of derivative pricing, emphasizing convergence rates and the curse of dimensionality. After a concise overview of traditional…

Pricing of Securities · Quantitative Finance 2025-02-26 Giacomo Case

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (CD) solver, and advances it in three aspects: intuition,…

Optimization and Control · Mathematics 2023-08-16 Bingcong Li , Georgios B. Giannakis

Multifidelity Monte Carlo methods often rely on a preprocessing phase consisting of standard Monte Carlo sampling to estimate correlation coefficients between models of different fidelity to determine the weights and number of samples for…

Data Analysis, Statistics and Probability · Physics 2021-06-29 Todd A. Oliver , Christopher S. Simmons , Robert D. Moser

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

This paper is devoted to studying the first-order variational analysis of non-convex and non-differentiable functions that may not be subdifferentially regular. To achieve this goal, we entirely rely on two concepts of directional…

Optimization and Control · Mathematics 2022-04-22 Ashkan Mohammadi

We investigate an approximate sampling scheme that can significantly reduce the cost scaling of variational Monte Carlo when it is employed to predict the energy differences associated with local chemical changes. Inspired by side-chaining…

Chemical Physics · Physics 2026-03-13 Sonja Bumann , Eric Neuscamman

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

We present a Jastrow-factor-inspired variant of coupled cluster theory that accurately describes both weak and strong electron correlation. Compatibility with quantum Monte Carlo allows for variational energy evaluations and an…

Strongly Correlated Electrons · Physics 2013-12-24 Eric Neuscamman

We present a new method for modeling electronically excited states that overcomes a key failing of linear response theory by allowing the underlying ground state ansatz to relax in the presence of an excitation. The method is variational,…

Chemical Physics · Physics 2016-09-21 Eric Neuscamman

Markov chain Monte Carlo (MCMC) methods require a large number of samples to approximate a posterior distribution, which can be costly when the likelihood or prior is expensive to evaluate. The number of samples can be reduced if we can…

Computation · Statistics 2019-08-06 V. Roshan Joseph , Dianpeng Wang , Li Gu , Shiji Lv , Rui Tuo

Real-time dispatch practices for operating the electric grid in an economic and reliable manner are evolving to accommodate higher levels of renewable energy generation. In particular, stochastic optimization is receiving increased…

Optimization and Control · Mathematics 2018-06-28 Ryan N. King , Matthew Reynolds , Devon Sigler , Wesley Jones

A compression algorithm is introduced for multi-determinant wave functions which can greatly reduce the number of determinants that need to be evaluated in quantum Monte Carlo calculations. We have devised an algorithm with three levels of…

Computational Physics · Physics 2015-06-17 Gihan L. Weerasinghe , Pablo Lopez Rios , Richard J. Needs

In this note we take a new look at the local convergence of alternating optimization methods for low-rank matrices and tensors. Our abstract interpretation as sequential optimization on moving subspaces yields insightful reformulations of…

Numerical Analysis · Mathematics 2019-01-14 Ivan Oseledets , Maxim Rakhuba , André Uschmajew

Bayesian model selection enables comparison and ranking of conceptual subsurface models described by spatial prior models, according to the support provided by available geophysical data. Deep generative neural networks can efficiently…

Geophysics · Physics 2021-05-19 M. Amaya , N. Linde , E. Laloy

All-electron variational and diffusion quantum Monte Carlo calculations of the ground state energies of the first row atoms (Li to Ne) are reported. We use trial wavefunctions of four types: single determinant Slater-Jastrow wavefunctions;…

Materials Science · Physics 2010-11-22 Matthew Brown , John Robert Trail , Pablo Lopez Rios , Richard Needs

We describe a regression-based method, generally referred to as the Least Squares Monte Carlo (LSMC) method, to speed up exposure calculations of a portfolio. We assume that the portfolio contains several exotic derivatives that are priced…

Computational Finance · Quantitative Finance 2021-05-18 Yuriy Krepkiy , Asif Lakhany , Amber Zhang