English
Related papers

Related papers: Derivative-free optimization for parameter estimat…

200 papers

Optimization of beamlines and lattices is a common problem in accelerator physics, which is usually solved with semi-analytical methods and numerical optimization routines. However, these are usually of the gradient-free or…

Accelerator Physics · Physics 2025-07-14 Francisco Huhn , Francesco M. Velotti

Simulating complex physical systems is crucial for understanding and predicting phenomena across diverse fields, such as fluid dynamics and heat transfer, as well as plasma physics and structural mechanics. Traditional approaches rely on…

A myriad of phenomena in materials science and chemistry rely on quantum-level simulations of the electronic structure in matter. While moving to larger length and time scales has been a pressing issue for decades, such large-scale…

The parameters of a neural network are naturally organized in groups, some of which might not contribute to its overall performance. To prune out unimportant groups of parameters, we can include some non-differentiable penalty to the…

Machine Learning · Computer Science 2023-01-06 Tristan Deleu , Yoshua Bengio

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Complexity analysis has become an important tool in the convergence analysis of optimization algorithms. For derivative-free optimization algorithms, it is not different. Interestingly, several constants that appear when developing…

Optimization and Control · Mathematics 2024-09-26 A. E. Schwertner , F. N. C. Sobral

Derivative-free optimization (DFO) is the mathematical study of the optimization algorithms that do not use derivatives. One branch of DFO focuses on model-based DFO methods, where an approximation of the objective function is used to guide…

Numerical Analysis · Mathematics 2016-12-16 Warren Hare

In this paper, we consider mixed-integer nonsmooth constrained optimization problems whose objective/constraint functions are available only as the output of a black-box zeroth-order oracle (i.e., an oracle that does not provide derivative…

Optimization and Control · Mathematics 2021-07-02 Tommaso Giovannelli , Giampaolo Liuzzi , Stefano Lucidi , Francesco Rinaldi

The topological derivative represents the sensitivity of a domain-dependent functional with respect to a local perturbation of the domain and is a valuable tool in topology optimization. Motivated by an application from electrical…

Optimization and Control · Mathematics 2020-01-24 Peter Gangl , Samuel Amstutz

Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. Finding optimized operation points for these complex machines is a challenging task, however, due to the large number of parameters…

Accelerator Physics · Physics 2021-07-02 Renato Bellotti , Romana Boiger , Andreas Adelmann

For a large class of variational quantum circuits, we show how arbitrary-order derivatives can be analytically evaluated in terms of simple parameter-shift rules, i.e., by running the same circuit with different shifts of the parameters. As…

Quantum Physics · Physics 2021-03-03 Andrea Mari , Thomas R. Bromley , Nathan Killoran

We study the uncertainties of quantum mechanical observables, quantified by the standard deviation (square root of variance) in Haar-distributed random pure states. We derive analytically the probability density functions (PDFs) of the…

Quantum Physics · Physics 2022-07-22 Lin Zhang , Jinping Huang , Jiamei Wang , Shao-Ming Fei

This paper investigates a series of optimization problems for one-counter Markov decision processes (MDPs) and integer-weighted MDPs with finite state space. Specifically, it considers problems addressing termination probabilities and…

Logic in Computer Science · Computer Science 2024-08-07 Jakob Piribauer , Christel Baier

Machine learning is employed to build an energy density functional for self-bound nuclear systems for the first time. By learning the kinetic energy as a functional of the nucleon density alone, a robust and accurate orbital-free density…

Nuclear Theory · Physics 2022-03-21 X. H. Wu , Z. X. Ren , P. W. Zhao

Many analyses in particle and nuclear physics use simulations to infer fundamental, effective, or phenomenological parameters of the underlying physics models. When the inference is performed with unfolded cross sections, the observables…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Owen Long , Benjamin Nachman

We present novel non-parametric representation math for local pseudopotentials (PP) based on Gaussian Process Regression (GPR). Local pseudopotentials are needed for materials simulations using Orbital-Free Density Functional Theory…

Materials Science · Physics 2021-01-27 Johann Lueder , Sergei Manzhos

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or…

Machine Learning · Computer Science 2019-08-06 Balázs Csanád Csáji , Krisztián Balázs Kis

A non-linear conjugate gradient optimization scheme is used to obtain excitation energies within the Random Phase Approximation (RPA). The solutions to the RPA eigenvalue equation are located through a variational characterization using a…

Materials Science · Physics 2011-11-21 Melissa J. Lucero , Anders M. N. Niklasson , Sergei Tretiak , Matt Challacombe

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish…

Optimization and Control · Mathematics 2024-06-04 Jochen Schmid , Philipp Seufert , Michael Bortz

A structured version of derivative-free random pattern search optimization algorithms is introduced which is able to exploit coordinate partially separable structure (typically associated with sparsity) often present in unconstrained and…

Optimization and Control · Mathematics 2021-01-13 Margherita Porcelli , Philippe L. Toint