English
Related papers

Related papers: Global optimization using Sobol indices

200 papers

Global optimization is an active area of research in atomistic simulations, and many algorithms have been proposed to date. A prominent example is basin hopping Monte Carlo, which performs a modified Metropolis Monte Carlo search to explore…

Chemical Physics · Physics 2020-02-04 Martín Leandro Paleico , Jörg Behler

We study zeroth-order optimization where solutions must minimize a cost $d(s)$ while maintaining high probability under a complex generative prior $L(s)$ (e.g., a parameterized model). This reduces to sampling from a target distribution…

Machine Learning · Computer Science 2026-05-06 Pranjal Awasthi , Sreenivas Gollapudi , Ravi Kumar , Kamesh Munagala

Sensitivity indices are commonly used to quantify the relative influence of any specific group of input variables on the output of a computer code. One crucial question is then to decide whether a given set of variables has a significant…

Statistics Theory · Mathematics 2022-04-05 Thierry Klein , Nicolas Peteilh , Paul Rochet

Computational models of the cardiovascular system are increasingly used for the diagnosis, treatment, and prevention of cardiovascular disease. Before being used for translational applications, the predictive abilities of these models need…

Applications · Statistics 2024-01-11 Friederike Schäfer , Daniele E. Schiavazzi , Leif Rune Hellevik , Jacob Sturdy

This work concerns the analysis and design of distributed first-order optimization algorithms over time-varying graphs. The goal of such algorithms is to optimize a global function that is the average of local functions using only local…

Optimization and Control · Mathematics 2020-02-17 Akhil Sundararajan , Bryan Van Scoy , Laurent Lessard

We introduce a novel first-order stochastic swarm intelligence (SI) model in the spirit of consensus formation models, namely a consensus-based optimization (CBO) algorithm, which may be used for the global optimization of a function in…

Probability · Mathematics 2017-10-06 René Pinnau , Claudia Totzeck , Oliver Tse , Stephan Martin

This article considers a box-constrained global optimization problem for Lipschitz-continuous functions with an unknown Lipschitz constant. Motivated by the famous DIRECT (DIviding RECTangles), a new HALRECT (HALving RECTangles) algorithm…

Optimization and Control · Mathematics 2022-09-20 Linas Stripinis , Remigijus Paulavičius

Global minimization is a fundamental challenge in optimization, especially in machine learning, where finding the global minimum of a function directly impacts model performance and convergence. This article introduces a novel optimization…

Machine Learning · Computer Science 2024-10-31 Seifeddine Achour

This paper provides an orientation angle optimization method for the design of fiber-reinforced composite materials using topology optimization. The orientation angle optimization is based on a topological derivative, which measures the…

Computational Engineering, Finance, and Science · Computer Science 2023-06-21 Masaki Noda , Kei Matsushima , Takayuki Yamada

We consider a distributed stochastic optimization problem in networks with finite number of nodes. Each node adjusts its action to optimize the global utility of the network, which is defined as the sum of local utilities of all nodes.…

Information Theory · Computer Science 2018-07-31 Wenjie Li , Mohamad Assaad

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

A structured version of derivative-free random pattern search optimization algorithms is introduced which is able to exploit coordinate partially separable structure (typically associated with sparsity) often present in unconstrained and…

Optimization and Control · Mathematics 2021-01-13 Margherita Porcelli , Philippe L. Toint

We investigate the fundamental principles that drive the development of scalable algorithms for network optimization. Despite the significant amount of work on parallel and decentralized algorithms in the optimization community, the methods…

Machine Learning · Statistics 2017-08-15 Patrick Rebeschini , Sekhar Tatikonda

In this paper, we consider a regression model built on dependent variables. This regression modelizes an input output relationship. Under boundedness assumptions on the joint distribution function of the input variables, we show that a…

Statistics Theory · Mathematics 2012-03-14 Gaëlle Chastaing , Fabrice Gamboa , Clémentine Prieur

We study the problem of global maximization of a function f given a finite number of evaluations perturbed by noise. We consider a very weak assumption on the function, namely that it is locally smooth (in some precise sense) with respect…

Machine Learning · Computer Science 2026-04-28 Michal Valko , Alexandra Carpentier , Rémi Munos

In many global optimization problems motivated by engineering applications, the number of function evaluations is severely limited by time or cost. To ensure that each evaluation contributes to the localization of good candidates for the…

Numerical Analysis · Mathematics 2025-10-20 Julien Villemonteix , Emmanuel Vazquez , Eric Walter

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng

We propose a new statistical estimation framework for a large family of global sensitivity analysis methods. Our approach is based on rank statistics and uses an empirical correlation coefficient recently introduced by Sourav Chatterjee. We…

Statistics Theory · Mathematics 2023-06-29 Fabrice Gamboa , Pierre Gremaud , Thierry Klein , Agnès Lagnoux

In this work, we study optimization specified only through a comparison oracle: given two points, it reports which one is preferred. We call it function-free optimization because we do not assume access to, nor the existence of, a canonical…

Optimization and Control · Mathematics 2026-05-20 Katya Scheinberg , Zikai Xiong

We describe the optimization algorithm implemented in the open-source derivative-free solver RBFOpt. The algorithm is based on the radial basis function method of Gutmann and the metric stochastic response surface method of Regis and…

Machine Learning · Computer Science 2021-02-02 Giacomo Nannicini