English
Related papers

Related papers: Force-Gradient Nested Multirate Methods for Hamilt…

200 papers

This paper can be seen as an attempt of rethinking the {\em Extra-Gradient Philosophy} for solving Variational Inequality Problems. We show that the properly defined {\em Reduced Gradients} can be used instead for finding approximate…

Optimization and Control · Mathematics 2023-12-05 Yurii Nesterov

Recently, the Hamilton Monte Carlo (HMC) has become widespread as one of the more reliable approaches to efficient sample generation processes. However, HMC is difficult to sample in a multimodal posterior distribution because the HMC chain…

Computation · Statistics 2020-06-22 Jonghyun Yun , Minsuk Shin , Ick Hoon Jin , Faming Liang

Many structured data-fitting applications require the solution of an optimization problem involving a sum over a potentially large number of measurements. Incremental gradient algorithms offer inexpensive iterations by sampling a subset of…

Numerical Analysis · Computer Science 2018-08-23 Michael P. Friedlander , Mark Schmidt

We present a set of new, efficient high-order symplectic methods designed for Hamiltonian systems with cubic or quartic potentials. By demonstrating that polynomial potentials require fewer order conditions, we develop schemes that…

Numerical Analysis · Mathematics 2026-05-11 Alejandro Escorihuela-Tomàs

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs…

Computation · Statistics 2019-11-19 Arya A. Pourzanjani , Linda R. Petzold

For quantum systems with competing potentials, the conventional perturbation theory often yields an asymptotic series and the subsequent numerical outcome becomes uncertain. To tackle such kind of problems, we develop a general solution…

Quantum Physics · Physics 2015-06-05 H. Mineo , Sheng D. Chao

Hamiltonian Monte Carlo (HMC) exploits Hamiltonian dynamics to construct efficient proposals for Markov chain Monte Carlo (MCMC). In this paper, we present a generalization of HMC which exploits \textit{non-canonical} Hamiltonian dynamics.…

Machine Learning · Statistics 2017-08-22 Nilesh Tripuraneni , Mark Rowland , Zoubin Ghahramani , Richard Turner

In this paper, we introduce a Lagrange multiplier approach to construct linearly implicit energy-preserving schemes of arbitrary order for general Hamiltonian PDEs. Unlike the widely used auxiliary variable methods, this novel approach does…

Numerical Analysis · Mathematics 2026-01-21 Yonghui Bo , Yushun Wang

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Symplectic schemes are powerful methods for numerically integrating Hamiltonian systems, and their long-term accuracy and fidelity have been proved both theoretically and numerically. However direct applications of standard symplectic…

Plasma Physics · Physics 2019-06-26 Jianyuan Xiao , Hong Qin

Simulation of many-particle system evolution by molecular dynamics takes to decrease integration step to provide numerical scheme stability on the sufficiently large time interval. It leads to a significant increase of the volume of…

Numerical Analysis · Mathematics 2016-05-19 Eduard G. Nikonov

The purpose of this paper is to introduce two new classes of accelerated distributed proximal conjugate gradient algorithms for multi-agent constrained optimization problems; given as minimization of a function decomposed as a sum of M…

Optimization and Control · Mathematics 2024-06-21 Anteneh Getachew Gebrie

Modified Hamiltonians are used in the field of geometric numerical integration to show that symplectic schemes for Hamiltonian systems are accurate over long times. For nonlinear systems the series defining the modified Hamiltonian usually…

Numerical Analysis · Mathematics 2018-11-14 Shami A Alsallami , Jitse Niesen , Frank W Nijhoff

We present a performant, general-purpose gradient-guided nested sampling algorithm, ${\tt GGNS}$, combining the state of the art in differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested…

Machine Learning · Computer Science 2023-12-08 Pablo Lemos , Nikolay Malkin , Will Handley , Yoshua Bengio , Yashar Hezaveh , Laurence Perreault-Levasseur

Operator splitting methods tailored to coupled linear port-Hamiltonian systems are developed. We present algorithms that are able to exploit scalar coupling, as well as multirate potential of these coupled systems. The obtained algorithms…

Numerical Analysis · Mathematics 2025-01-14 Jan Lorenz , Tom Zwerschke , Michael Günther , Kevin Schäfers

We investigate a hybrid numerical algorithm aimed at the large-scale cosmological N-body simulation for the on-going and the future high precious sky surveys. It makes use of a truncated Fast Multiple Method (FMM) for short-range gravity,…

Computational Physics · Physics 2021-01-13 Qiao Wang

This article considers Hamiltonian mechanical systems with potential functions admitting jump discontinuities. The focus is on accurate and efficient numerical approximations of their solutions, which will be defined via the laws of…

Numerical Analysis · Mathematics 2022-01-05 Molei Tao , Shi Jin

We study Hamiltonian Monte Carlo (HMC) samplers based on splitting the Hamiltonian $H$ as $H_0(\theta,p)+U_1(\theta)$, where $H_0$ is quadratic and $U_1$ small. We show that, in general, such samplers suffer from stepsize stability…

Computation · Statistics 2022-07-18 Fernando Casas , Jesús María Sanz-Serna , Luke Shaw

This article presents a new numerical scheme for the discretization of dissipative particle dynamics with conserved energy. The key idea is to reduce elementary pairwise stochastic dynamics (either fluctuation/dissipation or thermal…

Statistical Mechanics · Physics 2017-04-26 Gabriel Stoltz

Recently, continuous-time dynamical systems have proved useful in providing conceptual and quantitative insights into gradient-based optimization, widely used in modern machine learning and statistics. An important question that arises in…

Optimization and Control · Mathematics 2021-04-29 Guilherme França , Michael I. Jordan , René Vidal