English
Related papers

Related papers: Reactive Sample Size for Heuristic Search in Simul…

200 papers

Optimization-based samplers such as randomize-then-optimize (RTO) [2] provide an efficient and parallellizable approach to solving large-scale Bayesian inverse problems. These methods solve randomly perturbed optimization problems to draw…

Computation · Statistics 2019-10-29 Johnathan Bardsley , Tiangang Cui , Youssef Marzouk , Zheng Wang

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

Benchmarking optimization algorithms is fundamental for the advancement of computational intelligence. However, widely adopted artificial test suites exhibit limited correspondence with the diversity and complexity of real-world engineering…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 Stefan Ivić , Siniša Družeta , Luka Grbčić

We study an optimization-based approach to construct statistically accurate confidence intervals for simulation performance measures under nonparametric input uncertainty. This approach computes confidence bounds from simulation runs driven…

Methodology · Statistics 2019-02-14 Henry Lam , Huajie Qian

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

Path planning is typically considered in Artificial Intelligence as a graph searching problem and R* is state-of-the-art algorithm tailored to solve it. The algorithm decomposes given path finding task into the series of subtasks each of…

Artificial Intelligence · Computer Science 2015-11-04 Konstantin Yakovlev , Egor Baskin , Ivan Hramoin

Most optimization problems in real life applications are often highly nonlinear. Local optimization algorithms do not give the desired performance. So, only global optimization algorithms should be used to obtain optimal solutions. This…

Neural and Evolutionary Computing · Computer Science 2012-11-28 Mohammed El-Dosuky , Ahmed EL-Bassiouny , Taher Hamza , Magdy Rashad

This work considers infinite-horizon optimal control of positive linear systems applied to the case of network routing problems. We demonstrate the equivalence between Stochastic Shortest Path (SSP) problems and optimal control of a certain…

Optimization and Control · Mathematics 2026-02-17 David Ohlin , Anders Rantzer , Emma Tegling

In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a…

Numerical Analysis · Mathematics 2021-04-14 Daan Crommelin , Wouter Edeling

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

Real-time heuristic search algorithms are suitable for situated agents that need to make their decisions in constant time. Since the original work by Korf nearly two decades ago, numerous extensions have been suggested. One of the most…

Artificial Intelligence · Computer Science 2009-12-17 Valeriy K. Bulitko , Vadim Bulitko

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

This manuscript studies a general approach to construct confidence sets for the solution of stochastic optimization, rendering empirical risk minimization as special cases. Statistical inference for stochastic optimization poses significant…

Statistics Theory · Mathematics 2026-05-22 Kenta Takatsu , Arun Kumar Kuchibhotla

We consider the problem of automatically constructing computer programs from input-output examples. We investigate how to augment probabilistic and neural program synthesis methods with new search algorithms, proposing a framework called…

Machine Learning · Computer Science 2021-12-07 Nathanaël Fijalkow , Guillaume Lagarde , Théo Matricon , Kevin Ellis , Pierre Ohlmann , Akarsh Potta

Informative path planning algorithms are of paramount importance in applications like disaster management to efficiently gather information through a priori unknown environments. This is, however, a complex problem that involves finding a…

Robotics · Computer Science 2023-08-24 Mobolaji O. Orisatoki , Mahdi Amouzadi , Arash M. Dizqah

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

Inference-time scaling has emerged as a powerful technique for enhancing the reasoning performance of Large Language Models (LLMs). However, existing approaches often rely on heuristic strategies for parallel sampling, lacking a principled…

Machine Learning · Computer Science 2025-12-22 Youkang Wang , Jian Wang , Rubing Chen , Xiao-Yong Wei