English
Related papers

Related papers: Optimization Using Pathwise Algorithmic Derivative…

200 papers

Gradient-based optimization methods are commonly used to identify local optima in high-dimensional spaces. When derivatives cannot be evaluated directly, stochastic estimators can provide approximate gradients. However, these estimators'…

Machine Learning · Computer Science 2026-02-03 Philipp Andelfinger , Wentong Cai

A prototype tool to assist architects during the early design stage of floor plans has been developed, consisting of an Evolutionary Program for the Space Allocation Problem (EPSAP), which generates sets of floor plan alternatives according…

Computational Engineering, Finance, and Science · Computer Science 2013-08-06 Eugénio Rodrigues , Adélio Rodrigues Gaspar , Álvaro Gomes

Descriptors are physically-inspired schemes for representing atomistic systems that play a central role in the construction of models of potential energy surfaces. Although physical intuition can be flexibly encoded into descriptor schemes,…

Chemical Physics · Physics 2024-03-28 Gopal R. Iyer , Brenda M. Rubenstein

(Neal and Hinton, 1998) recast maximum likelihood estimation of any given latent variable model as the minimization of a free energy functional $F$, and the EM algorithm as coordinate descent applied to $F$. Here, we explore alternative…

Computation · Statistics 2023-02-21 Juan Kuntz , Jen Ning Lim , Adam M. Johansen

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

Machine Learning · Computer Science 2018-02-08 Hiva Ghanbari , Katya Scheinberg

A general method for computing derivatives of solution fields and other simulation outputs, with respect to arbitrary input quantities, is proposed. The method of automatic differentiation is used to carry out differentiation and propagate…

Computational Physics · Physics 2018-07-13 Christopher T. DeGroot

This paper proposes new ANOVA-based approximations of functions and emulators of high-dimensional models using either available derivatives or local stochastic evaluations of such models. Our approach makes use of sensitivity indices to…

Statistics Theory · Mathematics 2025-03-18 Matieyendou Lamboni

The demands placed on computational resources by the simulation requirements of high energy physics experiments motivate the development of novel simulation tools. Machine learning based generative models offer a solution that is both fast…

Instrumentation and Detectors · Physics 2023-04-03 Sascha Diefenbacher , Engin Eren , Frank Gaede , Gregor Kasieczka , Anatolii Korol , Katja Krüger , Peter McKeown , Lennart Rustige

Microscopic processes on surfaces such as adsorption, desorption, diffusion and reaction of interacting particles can be simulated using kinetic Monte Carlo (kMC) algorithms. Even though kMC methods are accurate, they are computationally…

Mathematical Physics · Physics 2013-12-24 Yannis Pantazis , Markos Katsoulakis

The precise reconstruction of properties of photons and electrons in modern high energy physics detectors, such as the CMS or Atlas experiments, plays a crucial role in numerous physics results. Conventional geometrical algorithms are used…

High Energy Physics - Experiment · Physics 2023-11-30 Polina Simkina , Fabrice Couderc , Julie Malclès , Mehmet Özgür Sahin

To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous…

Optimization and Control · Mathematics 2020-06-30 Ozgur Aydogmus , Ali Hakan Tor

To simulate the interaction of cosmic rays with the Earth atmosphere requires highly complex computational resources and several statistical techniques have been developed to simplify those calculations. It is common to implement the…

Instrumentation and Methods for Astrophysics · Physics 2015-12-10 A. Estupiñán , H. Asorey , L. A. Núñez

Algorithms that use derivatives of governing equations have accelerated rigid robot simulations and improved their accuracy, enabling the modeling of complex, real-world capabilities. However, extending these methods to soft and hybrid…

Robotics · Computer Science 2024-11-08 Anup Teejo Mathew , Frederic Boyer , Vincent Lebastard , Federico Renda

Liquid Argon Time Projection Chambers (LArTPCs) are a class of detectors that produce high resolution images of charged particles within their sensitive volume. In these images, the clustering of distinct particles into superstructures is…

Differentiable programming, enabled by automatic differentiation (AD), provides a robust framework for gradient-based optimization in computational plasma physics. While optimization is often only used towards design, we demonstrate that it…

Plasma Physics · Physics 2026-03-13 A. S. Joglekar , A. G. R. Thomas , A. L. Milder , K. G. Miller , J. P. Palastro , D. H. Froula

A simulation study of the energy released by extensive air showers in the form of MHz radiation is performed using the CoREAS simulation code. We develop an efficient method to extract this radiation energy from air-shower simulations. We…

High Energy Astrophysical Phenomena · Physics 2016-09-20 Christian Glaser , Martin Erdmann , Jörg R. Hörandel , Tim Huege , Johannes Schulz

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

(abridged) We develop an algorithm for estimating parameters of a distribution sampled with contamination, employing a statistical technique known as ``expectation maximization'' (EM). Given models for both member and contaminant…

Recent developments have created differentiable physics simulators designed for machine learning pipelines that can be accelerated on a GPU. While these can simulate biomechanical models, these opportunities have not been exploited for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 R. James Cotton

We develop EventMover, a differentiable parton shower event generator. This tool generates high- and variable-length scattering events that can be moved with simulation derivatives to change the value of the scale $\Lambda_\mathrm{QCD}$…

High Energy Physics - Phenomenology · Physics 2022-08-05 Benjamin Nachman , Stefan Prestel