English
Related papers

Related papers: Tuning HMC parameters with gradients

200 papers

We study --both in theory and practice-- the use of momentum motions in classic iterative hard thresholding (IHT) methods. By simply modifying plain IHT, we investigate its convergence behavior on convex optimization criteria with…

Optimization and Control · Mathematics 2019-09-17 Rajiv Khanna , Anastasios Kyrillidis

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

The tuning process of a large apparatus of many components could be represented and quantified by constructing parameter-tuning networks. The experimental tuning of the ion source of the neutral beam injector of HT-7 Tokamak is presented as…

Plasma Physics · Physics 2008-09-28 Xiao-Pu Han , Chun-Dong Hu , Zhi-Min Liu , Bing-Hong Wang

We develop, discuss, and compare several inference techniques to constrain theory parameters in collider experiments. By harnessing the latent-space structure of particle physics processes, we extract extra information from the simulator.…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli

The aim of this work is to learn models of population dynamics of physical systems that feature stochastic and mean-field effects and that depend on physics parameters. The learned models can act as surrogates of classical numerical models…

Machine Learning · Statistics 2024-10-28 Jules Berman , Tobias Blickhan , Benjamin Peherstorfer

We consider recent progress in algorithms for generating gauge field configurations that include the dynamical effects of light fermions. We survey what has been achieved in recent state-of-the-art computations, and examine the trade-offs…

High Energy Physics - Lattice · Physics 2009-11-10 A. D. Kennedy

We show how the integrators used for the molecular dynamics step of the Hybrid Monte Carlo algorithm can be further improved. These integrators not only approximately conserve some Hamiltonian $H$ but conserve exactly a nearby shadow…

High Energy Physics - Lattice · Physics 2015-05-30 M. A. Clark , Bálint Joó , A. D. Kennedy , P. J. Silva

Three approaches for adaptively tuning diagonal scale matrices for HMC are discussed and compared. The common practice of scaling according to estimated marginal standard deviations is taken as a benchmark. Scaling according to the mean…

Computation · Statistics 2024-03-13 Jimmy Huy Tran , Tore Selland Kleppe

The acceleration of gradient-based optimization methods is a subject of significant practical and theoretical importance, particularly within machine learning applications. While much attention has been directed towards optimizing within…

Optimization and Control · Mathematics 2024-11-12 Shi Chen , Qin Li , Oliver Tse , Stephen J. Wright

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Practitioners of Markov chain Monte Carlo (MCMC) may hesitate to use random walk Metropolis-Hastings algorithms, especially variable-at-a-time algorithms with many parameters, because these algorithms require users to select values of…

Computation · Statistics 2011-03-31 Todd L. Graves

We study the problem of learning the parameters for the Hamiltonian of a quantum many-body system, given limited access to the system. In this work, we build upon recent approaches to Hamiltonian learning via derivative estimation. We…

Quantum Physics · Physics 2024-01-10 Andi Gu , Lukasz Cincio , Patrick J. Coles

Joint space trajectory optimization under end-effector task constraints leads to a challenging non-convex problem. Thus, a real-time adaptation of prior computed trajectories to perturbation in task constraints often becomes intractable.…

The performance of policy gradient methods is sensitive to hyperparameter settings that must be tuned for any new application. Widely used grid search methods for tuning hyperparameters are sample inefficient and computationally expensive.…

Machine Learning · Computer Science 2019-09-19 Supratik Paul , Vitaly Kurin , Shimon Whiteson

In this extended abstract, we propose a tuning approach for nonlinear mechanical systems to modify the behavior of the closed-loop system, where we are particularly interested in attenuating oscillations from the transient response. Towards…

Systems and Control · Electrical Eng. & Systems 2020-09-02 Carmen Chan-Zheng , Pablo Borja , Jacquelien M. A. Scherpen

In this paper we develop a Bayesian optimization based hyperparameter tuning framework inspired by statistical learning theory for classifiers. We utilize two key facts from PAC learning theory; the generalization bound will be higher for a…

Machine Learning · Computer Science 2019-02-08 Tinu Theckel Joy , Santu Rana , Sunil Gupta , Svetha Venkatesh

The design of the proposal distributions, and most notably the kernel parameters, are crucial for the performance of Markov chain Monte Carlo (MCMC) rendering. A poor selection of parameters can increase the correlation of the Markov chain…

This study performs parameter inference in a partial differential equations system of pulmonary circulation. We use a fluid dynamics network model that takes selected parameter values and mimics the behaviour of the pulmonary haemodynamics…

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay