English
Related papers

Related papers: Universal performance bounds of restart

200 papers

Algorithms often have tunable parameters that impact performance metrics such as runtime and solution quality. For many algorithms used in practice, no parameter settings admit meaningful worst-case bounds, so the parameters are made…

Machine Learning · Computer Science 2021-04-27 Maria-Florina Balcan , Dan DeBlasio , Travis Dick , Carl Kingsford , Tuomas Sandholm , Ellen Vitercik

In the classical stochastic resetting problem, a particle, moving according to some stochastic dynamics, undergoes random interruptions that bring it to a selected domain, and then, the process recommences. Hitherto, the resetting mechanism…

Statistical Mechanics · Physics 2020-12-08 Carlos A. Plata , Deepak Gupta , Sandro Azaele

This paper examines restart strategies for algorithms whose successful termination depends on an unknown parameter $\lambda$. After each restart, $\lambda$ is increased, until the algorithm terminates successfully. It is assumed that there…

Optimization and Control · Mathematics 2025-01-20 Lisa Schönenberger , Hans-Georg Beyer

Stochastic processes that are randomly reset to an initial condition serve as a showcase to investigate non-equilibrium steady states. However, all existing results have been restricted to the special case of memoryless resetting protocols.…

Statistical Mechanics · Physics 2016-03-23 Stephan Eule , Jakob Metzger

We propose a new iterative procedure to optimize the restart for meta-heuristic algorithms to solve combinatorial optimization, which uses independent algorithm executions. The new procedure consists of either adding new executions or…

Optimization and Control · Mathematics 2017-09-20 Davide Palmigiani , Giovanni Sebastiani

In this paper we investigate the normal and the large fluctuations of additive functionals associated with a stochastic process under a general non-Poissonian resetting mechanism. Cumulative functionals of regenerative processes are very…

Probability · Mathematics 2023-04-24 Marco Zamparo

``When in a difficult situation, it is sometimes better to give up and start all over again''. While this empirical truth has been regularly observed in a wide range of circumstances, quantifying the effectiveness of such a heuristic…

Statistical Mechanics · Physics 2023-02-20 Benjamin De Bruyne , Francesco Mori

Algorithms for computing equilibria, optima, and fixed points in nonconvex problems often depend sensitively on practitioner-chosen initial conditions. When uniqueness of a solution is of interest, a common heuristic is to run such…

Econometrics · Economics 2026-02-17 Moeen Nehzati , Diego Cussen

The effects of a stochastic reset, to its initial configuration, is studied in the exactly solvable one-dimensional coagulation-diffusion process. A finite resetting rate leads to a modified non-equilibrium stationary state. If in addition…

Statistical Mechanics · Physics 2014-02-04 Xavier Durang , Malte Henkel , Hyunggyu Park

We consider the mean first passage time (MFPT) for a diffusive particle in a potential landscape with the extra condition that the particle is reset to its original position with some rate r. We study non-smooth and non-convex potentials…

Statistical Mechanics · Physics 2025-09-16 Johannes Aspman , Daniel Mastropietro , Jakub Marecek

In this paper, we examine the fundamental performance limits of prediction, with or without side information. More specifically, we derive generic lower bounds on the $\mathcal{L}_p$ norms of the prediction errors that are valid for any…

Machine Learning · Computer Science 2021-06-07 Song Fang , Quanyan Zhu

For Markov processes over discrete configurations, an asymptotic bound on the uncertainty of stochastic fluxes is derived in terms of the harmonic mean of decay rates with respect to the stationary distribution. This bound is necessarily…

Statistical Mechanics · Physics 2024-07-16 Katarzyna Macieszczak

We propose a universal framework to compute record age statistics of a stochastic time-series that undergoes random restarts. The proposed framework makes minimal assumptions on the underlying process and is furthermore suited to treat…

Statistical Mechanics · Physics 2023-04-28 Aanjaneya Kumar , Arnab Pal

By periodically returning a search process to a known or random state, random resetting possesses the potential to unveil new trajectories, sidestep potential obstacles, and consequently enhance the efficiency of locating desired targets.…

Statistical Mechanics · Physics 2024-12-31 Arnab Pal , Viktor Stojkoski , Trifce Sandev

We study how stochastic resetting affects first-passage processes in systems of many interacting particles. While resetting is well understood for single-particle dynamics, its consequences for collective behavior remain less clear. We…

Statistical Mechanics · Physics 2026-04-28 Juhee Lee , Seong-Gyu Yang , Ludvig Lizana

Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If…

Neural and Evolutionary Computing · Computer Science 2023-11-06 Weijie Zheng , Benjamin Doerr

We introduce a novel time-energy uncertainty relation within the context of restarts in monitored quantum dynamics. Initially, we investigate the concept of ``first hitting time'' in quantum systems using an IBM quantum computer and a…

Statistical Mechanics · Physics 2025-01-07 Ruoyu Yin , Qingyuan Wang , Sabine Tornow , Eli Barkai

Numerous purportedly improved metaheuristics claim superior performance based on equivalent function evaluations (FEs), yet often conceal additional computational burdens in more intensive iterations, preprocessing stages, or hyperparameter…

Neural and Evolutionary Computing · Computer Science 2025-09-12 Junbo Jacob Lian

Many machine learning approaches are characterized by information constraints on how they interact with the training data. These include memory and sequential access constraints (e.g. fast first-order methods to solve stochastic…

Machine Learning · Computer Science 2014-10-29 Ohad Shamir

We establish general conditions under which there exists uniform in time convergence between a stochastic process and its approximated system. These standardised conditions consist of a local in time estimate between the original and the…

Probability · Mathematics 2024-12-09 Katharina Schuh , Iain Souttar