English
Related papers

Related papers: Hopping between distant basins

200 papers

The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density.…

Computation · Statistics 2019-12-04 Sebastian M. Schmon , George Deligiannidis , Arnaud Doucet , Michael K. Pitt

Optimization of non-convex loss surfaces containing many local minima remains a critical problem in a variety of domains, including operations research, informatics, and material design. Yet, current techniques either require extremely high…

Machine Learning · Computer Science 2021-07-21 Amil Merchant , Luke Metz , Sam Schoenholz , Ekin Dogus Cubuk

Human-in-the-loop Bayesian optimization (HITL BO) methods utilize human expertise to improve the sample-efficiency of BO. Most HITL BO methods assume that a domain expert can quantify their knowledge, for instance by pinpointing query…

Machine Learning · Computer Science 2026-05-13 Alvar Haltia , Ville Hyvönen , Samuel Kaski

In this paper, we introduce a new heuristics for global optimization in scenarios where extensive evaluations of the cost function are expensive, inaccessible, or even prohibitive. The method, which we call Landscape-Sketch-and-Step (LSS),…

Machine Learning · Computer Science 2023-10-06 Rafael Monteiro , Kartik Sau

We present a new method, called SISYPHUS (Stochastic Iterations to Strengthen Yield of Path Hopping over Upper States), for extending accessible time-scales in atomistic simulations. The method proceeds by separating phase space into…

Materials Science · Physics 2015-03-12 Pratyush Tiwary , Axel van de Walle

Handover (HO) management has attracted attention of research in the context of wireless cellular communication networks. One crucial problem of HO management is to deal with increasing HOs experienced by a mobile user. To address this…

Networking and Internet Architecture · Computer Science 2020-08-26 Kiichi Tokuyama , Tatsuaki Kimura , Naoto Miyoshi

Stochastic sequential decision making often requires hierarchical structure in the problem where each high-level action should be further planned with primitive states and actions. In addition, many real-world applications require a plan…

Artificial Intelligence · Computer Science 2022-05-12 Sungkweon Hong , Brian C. Williams

High-dimensional and complex discrete distributions often exhibit multimodal behavior due to inherent discontinuities, posing significant challenges for sampling. Gradient-based discrete samplers, while effective, frequently become trapped…

Machine Learning · Computer Science 2026-04-14 Pinaki Mohanty , Ruqi Zhang

Stochastic proximal point methods have recently garnered renewed attention within the optimization community, primarily due to their desirable theoretical properties. Notably, these methods exhibit a convergence rate that is independent of…

Optimization and Control · Mathematics 2024-12-19 Elnur Gasanov , Peter Richtárik

The Davydov D1 ansatz, which assigns an individual bosonic trajectory to each spin state, is an efficient, yet extremely accurate trial state for time-dependent variation of the sub-Ohmic spin-boson model [J. Chem. Phys. 138, 084111…

Chemical Physics · Physics 2015-06-16 Yao Yao , Yang Zhao

Deployments of Bayesian Optimization (BO) for functions with stochastic evaluations, such as parameter tuning via cross validation and simulation optimization, typically optimize an average of a fixed set of noisy realizations of the…

Machine Learning · Computer Science 2020-07-03 Henry B. Moss , David S. Leslie , Paul Rayson

Dynamical systems having many coexisting attractors present interesting properties from both fundamental theoretical and modelling points of view. When such dynamics is under bounded random perturbations, the basins of attraction are no…

A hybrid evolutionary algorithm with importance sampling method is proposed for multi-dimensional optimization problems in this paper. In order to make use of the information provided in the search process, a set of visited solutions is…

Neural and Evolutionary Computing · Computer Science 2013-08-26 Guanghui Huang , Zhifeng Pan

The emergence of Big Data has enabled new research perspectives in the discrete choice community. While the techniques to estimate Machine Learning models on a massive amount of data are well established, these have not yet been fully…

Optimization and Control · Mathematics 2020-12-23 Gael Lederrey , Virginie Lurkin , Tim Hillel , Michel Bierlaire

We propose here some new sampling algorithms for Path Sampling in the case when stochastic dynamics are used. In particular, we present a new proposal function for equilibrium sampling of paths with a Monte-Carlo dynamics (the so-called…

Statistical Mechanics · Physics 2009-11-11 Gabriel Stoltz

We present SEBOOST, a technique for boosting the performance of existing stochastic optimization methods. SEBOOST applies a secondary optimization process in the subspace spanned by the last steps and descent directions. The method was…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Elad Richardson , Rom Herskovitz , Boris Ginsburg , Michael Zibulevsky

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

In this work, we consider convex optimization problems with smooth objective function and nonsmooth functional constraints. We propose a new stochastic gradient algorithm, called Stochastic Halfspace Approximation Method (SHAM), to solve…

Optimization and Control · Mathematics 2024-12-04 Nitesh Kumar Singh , Ion Necoara

The computational efficiency of stochastic simulation algorithms is notoriously limited by the kinetic trapping of the simulated trajectories within low energy basins. Here we present a new method that overcomes kinetic trapping while still…

Statistical Mechanics · Physics 2014-12-08 Manuel Athènes , Vasily V. Bulatov

We present a new method for stochastic shape optimisation of engineering structures. The method generalises an existing deterministic scheme, in which the structure is represented and evolved by a level-set method coupled with mathematical…

Statistical Mechanics · Physics 2017-09-13 Lester O. Hedges , H. Alicia Kim , Robert L. Jack