English
Related papers

Related papers: On the Thermodynamics of Global Optimization

200 papers

Global changes of states are of crucial importance in optimization algorithms. We review some heuristic algorithms in which global updates are realized by a sort of real-space renormalization group transformation. Emphasis is on the…

Disordered Systems and Neural Networks · Physics 2009-10-31 Naoki Kawashima

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

Efficient global optimization is a widely used method for optimizing expensive black-box functions such as tuning hyperparameter, and designing new material, etc. Despite its popularity, less attention has been paid to analyzing the…

Optimization and Control · Mathematics 2022-09-21 Wenjie Xu , Yuning Jiang , Emilio T. Maddalena , Colin N. Jones

The EM (Expectation-Maximization) algorithm is regarded as an MM (Majorization-Minimization) algorithm for maximum likelihood estimation of statistical models. Expanding this view, this paper demonstrates that by choosing an appropriate…

Optimization and Control · Mathematics 2026-02-12 Kensuke Asai , Jun-ya Gotoh

We propose a simple scheme to estimate potential energy surface (PES) with which the accuracy can be easily controlled and improved up to the level of the density functional theory (DFT) calculations. It is based on a model selection within…

Materials Science · Physics 2014-07-11 Atsuto Seko , Akira Takahashi , Isao Tanaka

A central problem of materials science is to determine whether a hypothetical material is stable without being synthesized, which is mathematically equivalent to a global optimization problem on a highly non-linear and multi-modal potential…

Applications · Statistics 2023-05-02 Arvind Krishna , Huan Tran , Chaofan Huang , Rampi Ramprasad , V. Roshan Joseph

Determination of \emph{optimal} arrangements of $N$ particles on a sphere is a well-known problem in physics. A famous example of such is the Thomson problem of finding equilibrium configurations of electrical charges on a sphere. More…

Computational Physics · Physics 2019-11-06 Wesley J. M. Ridgway , Alexei F. Cheviakov

An analysis of the network defined by the potential energy minima of multi-atomic systems and their connectivity via reaction pathways that go through transition states allows to understand important characteristics like thermodynamic,…

Materials Science · Physics 2016-08-03 Bastian Schaefer , Stefan Goedecker

Equalities are generally more suitable for experimental verification than inequalities. In this work, I derive valid equalities from the Euler-Lagrange equation for the optimization of macroscopic thermodynamic averages in weakly driven…

Statistical Mechanics · Physics 2025-11-06 Pierre Nazé

We present a global optimizer, based on a conditional generative neural network, which can output ensembles of highly efficient topology-optimized metasurfaces operating across a range of parameters. A key feature of the network is that it…

Machine Learning · Computer Science 2019-07-18 Jiaqi Jiang , Jonathan A. Fan

This paper propose a new frame work for finding global minima which we call optimization by cut. In each iteration, it takes some samples from the feasible region and evaluates the objective function at these points. Based on the…

Systems and Control · Electrical Eng. & Systems 2022-07-14 Yuanyuan Liu

Placement is crucial in the physical design, as it greatly affects power, performance, and area metrics. Recent advancements in analytical methods, such as DREAMPlace, have demonstrated impressive performance in global placement. However,…

Machine Learning · Computer Science 2024-02-29 Ke Xue , Xi Lin , Yunqi Shi , Shixiong Kai , Siyuan Xu , Chao Qian

Global optimization is an active area of research in atomistic simulations, and many algorithms have been proposed to date. A prominent example is basin hopping Monte Carlo, which performs a modified Metropolis Monte Carlo search to explore…

Chemical Physics · Physics 2020-02-04 Martín Leandro Paleico , Jörg Behler

Global optimization, particularly for non-convex functions with multiple local minima, poses significant challenges for traditional gradient-based methods. While metaheuristic approaches offer empirical effectiveness, they often lack…

Machine Learning · Computer Science 2026-05-12 Andrea Agazzi , Vittorio Carlei , Marco Romito , Samuele Saviozzi

Anticipating the low energy arrangements of atoms in space is an indispensable scientific task. Modern stochastic approaches to searching for these configurations depend on the optimisation of structures to nearby local minima in the energy…

Materials Science · Physics 2019-02-07 Chris J. Pickard

Optimal control of stochastic systems plays a central role in nonequilibrium physics, with applications in the study of biological molecular motors and the design of single-molecule experiments. While exact analytic solutions to…

Statistical Mechanics · Physics 2026-01-07 Jordan R. Sawchuk , David A. Sivak

Optimization problems have been the subject of statistical physics approximations. A specially relevant and general scenario is provided by optimization methods considering tradeoffs between cost and efficiency, where optimal solutions…

Statistical Mechanics · Physics 2015-09-16 Luís F. Seoane , Ricard V. Solé

Many problems arise in computational biology can be reduced to the minimization of energy function, that determines on the geometry of considered molecule. The solution of this problem allows in particular to solve folding and docking…

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

Mixed membership factorization is a popular approach for analyzing data sets that have within-sample heterogeneity. In recent years, several algorithms have been developed for mixed membership matrix factorization, but they only guarantee…

Methodology · Statistics 2016-10-26 Fan Zhang , Chuangqi Wang , Andrew Trapp , Patrick Flaherty