English
Related papers

Related papers: Tuning HMC parameters with gradients

200 papers

The past few years have seen considerable progress in algorithmic development for the generation of gauge fields including the effects of dynamical fermions. The Rational Hybrid Monte Carlo (RHMC) algorithm, where Hybrid Monte Carlo is…

High Energy Physics - Lattice · Physics 2008-11-26 M. A. Clark

Parallel tempering is a meta-algorithm for Markov Chain Monte Carlo that uses multiple chains to sample from tempered versions of the target distribution, enhancing mixing in multi-modal distributions that are challenging for traditional…

Computation · Statistics 2024-12-30 Daniel Zhao , Natesh S. Pillai

We propose adaptation strategies to modify the standard constrained model predictive controller scheme in order to guarantee a certain lower bound on the degree of suboptimality. Within this analysis, the length of the optimization horizon…

Optimization and Control · Mathematics 2015-03-19 Jürgen Pannek

Standard first-order stochastic optimization algorithms base their updates solely on the average mini-batch gradient, and it has been shown that tracking additional quantities such as the curvature can help de-sensitize common…

Machine Learning · Computer Science 2020-11-11 Ricky T. Q. Chen , Dami Choi , Lukas Balles , David Duvenaud , Philipp Hennig

In the simplified setting of the Schwinger model we present a systematic study on the simulation of dynamical fermions by global accept/reject steps that take into account the fermion determinant. A family of exact algorithms is developed,…

High Energy Physics - Lattice · Physics 2008-11-26 Francesco Knechtli , Ulli Wolff

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

Momentum is a popular technique for improving convergence rates during gradient descent. In this research, we experiment with adding momentum to the Baum-Welch expectation-maximization algorithm for training Hidden Markov Models. We compare…

Machine Learning · Computer Science 2022-06-10 Andrew Miller , Fabio Di Troia , Mark Stamp

This paper proposes a novel parameter selection strategy for kernel-based gradient descent (KGD) algorithms, integrating bias-variance analysis with the splitting method. We introduce the concept of empirical effective dimension to quantify…

Machine Learning · Statistics 2026-03-05 Xiaotong Liu , Yunwen Lei , Xiangyu Chang , Shao-Bo Lin

This paper deals with estimating model parameters in graphical models. We reformulate it as an information geometric optimization problem and introduce a natural gradient descent strategy that incorporates additional meta parameters. We…

Machine Learning · Computer Science 2019-05-15 Eric Benhamou , Jamal Atif , Rida Laraki , David Saltiel

We discuss how dynamical fermion computations may be made yet cheaper by using symplectic integrators that conserve energy much more accurately without decreasing the integration step size. We first explain why symplectic integrators…

High Energy Physics - Lattice · Physics 2008-11-26 M. A. Clark , A. D. Kennedy

In a quantum processor, the device design and external controls together contribute to the quality of the target quantum operations. As we continuously seek better alternative qubit platforms, we explore the increasingly large device and…

Quantum Physics · Physics 2023-12-08 Xiaotong Ni , Hui-Hai Zhao , Lei Wang , Feng Wu , Jianxin Chen

Tuning parameters are parameters involved in an estimating procedure for the purpose of reducing the risk of some other estimator. Examples include the degree of penalization in penalized regression and likelihood problems, as well as the…

Statistics Theory · Mathematics 2026-03-31 Ingrid Dæhlen , Nils Lid Hjort , Ingrid Hobæk Haff

This paper investigates controller identification given data from a Model Predictive Controller (MPC) with constraints. We propose an approach for learning MPC that explicitly uses the gradient information in the training process. This is…

Systems and Control · Electrical Eng. & Systems 2021-02-04 Rebecka Winqvist , Arun Venkitaraman , Bo Wahlberg

When dealing with datasets containing a billion instances or with simulations that require a supercomputer to execute, computational resources become part of the equation. We can improve the efficiency of learning and inference by…

Machine Learning · Computer Science 2014-03-06 Max Welling

We develop an online gradient algorithm for optimizing the performance of product-form networks through online adjustment of control parameters. The use of standard algorithms for finding optimal parameter settings is hampered by the…

Optimization and Control · Mathematics 2012-08-31 Jaron Sanders , Sem C. Borst , Johan S. H. van Leeuwaarden

The conjugate gradient method (CG) is typically used with a preconditioner which improves efficiency and robustness of the method. Many preconditioners include parameters and a proper choice of a preconditioner and its parameters is often…

Numerical Analysis · Mathematics 2019-06-04 Alexandr Katrutsa , Mike Botchev , George Ovchinnikov , Ivan Oseledets

Robotic systems often operate with uncertainties in their dynamics, for example, unknown inertial properties. Broadly, there are two approaches for controlling uncertain systems: design robust controllers in spite of uncertainty, or…

Robotics · Computer Science 2019-06-10 Keenan Albee , Monica Ekal , Rodrigo Ventura , Richard Linares

Traversing narrow gates presents a significant challenge and has become a standard benchmark for evaluating agile and precise quadrotor flight. Traditional modularized autonomous flight stacks require extensive design and parameter tuning,…

Robotics · Computer Science 2026-03-06 Tianchen Sun , Bingheng Wang , Nuthasith Gerdpratoom , Longbin Tang , Yichao Gao , Lin Zhao

Quantum metrology leverages quantum resources such as entanglement and squeezing to enhance parameter estimation precision beyond classical limits. While optimal quantum control strategies can assist to reach or even surpass the Heisenberg…

Quantum Physics · Physics 2025-10-17 Qifei Wei , Shengshi Pang

The problem of parameterization is often central to the effective deployment of nature-inspired algorithms. However, finding the optimal set of parameter values for a combination of problem instance and solution method is highly…

Neural and Evolutionary Computing · Computer Science 2014-06-26 Matthew Crossley , Andy Nisbet , Martyn Amos
‹ Prev 1 3 4 5 6 7 10 Next ›