English
Related papers

Related papers: A black box method for solving the complex exponen…

200 papers

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Stochastic Approximation has been a prominent set of tools for solving problems with noise and uncertainty. Increasingly, it becomes important to solve optimization problems wherein there is noise in both a set of constraints that a…

Optimization and Control · Mathematics 2025-07-29 Francisco Facchinei , Vyacheslav Kungurtsev

We present a numerical algorithm for finding real non-negative solutions to polynomial equations. Our methods are based on the expectation maximization and iterative proportional fitting algorithms, which are used in statistics to find…

Numerical Analysis · Mathematics 2010-04-02 Dustin Cartwright

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

We analyze the excision strategy for simulating black holes. The problem is modeled by the propagation of quasi-linear waves in a 1-dimensional spatial region with timelike outer boundary, spacelike inner boundary and a horizon in between.…

General Relativity and Quantum Cosmology · Physics 2008-11-26 B. Szilagyi , H-O. Kreiss , J. Winicour

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

The quality of enumeration algorithms is often measured by their delay, that is, the maximal time spent between the output of two distinct solutions. If the goal is to enumerate $t$ distinct solutions for any given $t$, then another…

Computational Complexity · Computer Science 2024-09-04 Florent Capelli , Yann Strozecki

In this letter, we employ and design the expectation--conditional maximization either (ECME) algorithm, a generalisation of the EM algorithm, for solving the maximum likelihood direction finding problem of stochastic sources, which may be…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Ming-yan Gong , Bin Lyu

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive…

Machine Learning · Statistics 2016-06-01 Rajesh Ranganath , Dustin Tran , David M. Blei

This paper addresses the estimation of uncertain distributed diffusion coefficients in elliptic systems based on noisy measurements of the model output. We formulate the parameter identification problem as an infinite dimensional…

Optimization and Control · Mathematics 2015-06-11 Jeff Borggaard , Hans-Werner van Wyk

Black-box alpha (BB-$\alpha$) is a new approximate inference method based on the minimization of $\alpha$-divergences. BB-$\alpha$ scales to large datasets because it can be implemented using stochastic gradient descent. BB-$\alpha$ can be…

Modeling the arrival process to an Emergency Department (ED) is the first step of all studies dealing with the patient flow within the ED. Many of them focus on the increasing phenomenon of ED overcrowding, which is afflicting hospitals all…

Optimization and Control · Mathematics 2021-01-28 A. De Santis , T. Giovannelli , S. Lucidi , M. Messedaglia , M. Roma

This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach,…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Peihu Duan , Qishao Wang , Zhisheng Duan , Guanrong Chen

For safety-critical black-box optimization tasks, observations of the constraints and the objective are often noisy and available only for the feasible points. We propose an approach based on log barriers to find a local solution of a…

Optimization and Control · Mathematics 2021-02-25 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

We propose a multi-tone decomposition algorithm that can find the frequencies, amplitudes and phases of the fundamental sinusoids in a noisy observation sequence. Under independent identically distributed Gaussian noise, our method utilizes…

Signal Processing · Electrical Eng. & Systems 2022-03-29 Kaan Gokcesu , Hakan Gokcesu

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

A method is suggested for treating those complicated physical problems for which exact solutions are not known but a few approximation terms of a calculational algorithm can be derived. The method permits one to answer the following rather…

High Energy Physics - Phenomenology · Physics 2009-10-31 V. I. Yukalov , E. P. Yukalova

With advances in scientific computing, computer experiments are increasingly used for optimizing complex systems. However, for modern applications, e.g., the optimization of nuclear physics detectors, each experiment run can require…

Machine Learning · Statistics 2025-08-08 Hwanwoo Kim , Simon Mak , Ann-Kathrin Schuetz , Alan Poon