English
Related papers

Related papers: An Analysis of Approximation Algorithms for Iterat…

200 papers

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

A sequential quadratic programming method is designed for solving general smooth nonlinear stochastic optimization problems subject to expectation equality constraints. We consider the setting where the objective and constraint function…

Optimization and Control · Mathematics 2026-03-17 Haoming Shen , Yang Zeng , Baoyu Zhou

In this work, we develop a highly efficient representation of functions and differential operators based on Fourier analysis. Using this representation, we create a variational hybrid quantum algorithm to solve static, Schr\"odinger-type,…

In this paper, we study a class of bilevel programming problem where the inner objective function is strongly convex. More specifically, under some mile assumptions on the partial derivatives of both inner and outer objective functions, we…

Optimization and Control · Mathematics 2018-02-08 Saeed Ghadimi , Mengdi Wang

Unitary best approximation to the exponential function on an interval on the imaginary axis has been introduced recently. In the present work two algorithms are considered to compute this best approximant: an algorithm based on rational…

Numerical Analysis · Mathematics 2025-04-15 Tobias Jawecki

We investigate integral formulations and fast algorithms for the steady-state radiative transfer equation with isotropic and anisotropic scattering. When the scattering term is a smooth convolution on the unit sphere, a model reduction step…

Numerical Analysis · Mathematics 2019-02-20 Yuwei Fan , Jing An , Lexing Ying

Gaussian Processes have become an indispensable part of the spatial statistician's toolbox but are unsuitable for analyzing large dataset because of the significant time and memory needed to fit the associated model exactly. Vecchia…

Computation · Statistics 2025-07-18 Zachary James , Joseph Guinness

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

We introduce a simulation scheme for Brownian semistationary processes, which is based on discretizing the stochastic integral representation of the process in the time domain. We assume that the kernel function of the process is regularly…

Probability · Mathematics 2018-09-24 Mikkel Bennedsen , Asger Lunde , Mikko S. Pakkanen

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

The article presents a computationally effective algorithm for calculating the multiresolution discrete Fourier transform (MrDFT). The algorithm is based on the idea of reducing the computational complexity which was introduced by Wen and…

Data Structures and Algorithms · Computer Science 2015-07-10 Bartosz Andreatto , Aleksandr Cariow

In this paper, we propose iterative inner/outer approximations based on a recent notion of block factor-width-two matrices for solving semidefinite programs (SDPs). Our inner/outer approximating algorithms generate a sequence of upper/lower…

Optimization and Control · Mathematics 2022-09-30 Feng-Yi Liao , Yang Zheng

This paper considers the problem of minimizing a convex expectation function with a set of inequality convex expectation constraints. We present a computable stochastic approximation type algorithm, namely the stochastic linearized proximal…

Optimization and Control · Mathematics 2022-06-16 Liwei Zhang , Yule Zhang , Jia Wu , Xiantao Xiao

Gradient-based methods are well-suited for derivative-free optimization (DFO), where finite-difference (FD) estimates are commonly used as gradient surrogates. Traditional stochastic approximation methods, such as Kiefer-Wolfowitz (KW) and…

Optimization and Control · Mathematics 2025-03-03 Guo Liang , Guangwu Liu , Kun Zhang

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

In this work the numerical solution of acoustic tomography problem based on the iterative and functional-analytical algorithms is considered. The mathematical properties of these algorithms were previously described in works of R.G.Novikov…

Numerical Analysis · Mathematics 2024-01-26 A. S. Shurup

There is growing interest in learning Fourier domain sampling strategies (particularly for magnetic resonance imaging, MRI) using optimization approaches. For non-Cartesian sampling patterns, the system models typically involve non-uniform…

Image and Video Processing · Electrical Eng. & Systems 2023-02-07 Guanhua Wang , Jeffrey A. Fessler

We investigate numerically efficient approximations of eigenspaces associated to symmetric and general matrices. The eigenspaces are factored into a fixed number of fundamental components that can be efficiently manipulated (we consider…

Machine Learning · Computer Science 2021-09-29 Cristian Rusu , Lorenzo Rosasco

We investigate ancilla-free linear combination of unitaries (LCU) as a framework for approximating complex quantum circuits. This is particularly effective for quantum optimization algorithms, where candidate solutions can be evaluated…

Quantum Physics · Physics 2026-05-20 Almudena Carrera Vazquez , Daniel J. Egger , Stefan Woerner