English
Related papers

Related papers: On converting any one-step method to a variational…

200 papers

Optimization algorithms can be interpreted through the lens of dynamical systems as the interconnection of linear systems and a set of subgradient nonlinearities. This dynamical systems formulation allows for the analysis and synthesis of…

Optimization and Control · Mathematics 2026-03-27 Jared Miller , Carsten Scherer , Fabian Jakob , Andrea Iannelli

Control schemes for dynamical systems typically involve stabilizing unstable periodic orbits. In this paper we introduce a new paradigm of control that involves `trapping' the dynamics arbitrarily close to any desired trajectory. This is…

Chaotic Dynamics · Physics 2015-12-08 Shakti N. Menon , S. Sridhar , Sitabhra Sinha

Classical algorithms for predicting the equilibrium geometry of strongly correlated molecules require expensive wave function methods that become impractical already for few-atom systems. In this work, we introduce a variational quantum…

Symplectic integration algorithms are well-suited for long-term integrations of Hamiltonian systems because they preserve the geometric structure of the Hamiltonian flow. However, this desirable property is generally lost when adaptive…

Astrophysics · Physics 2025-10-20 Miguel Preto , Scott Tremaine

In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given…

Numerical Analysis · Mathematics 2022-10-12 Monika Eisenmann , Tony Stillfjord

The multiplicative Newton-like method developed by the author et al. is extended to the situation where the dynamics is restricted to the orthogonal group. A general framework is constructed without specifying the cost function. Though the…

Machine Learning · Computer Science 2007-05-23 Toshinao Akuzawa

In recent decades, there have been many attempts to construct symplectic integrators with variable time steps, with rather disappointing results. In this paper we identify the causes for this lack of performance, and find that they fall…

Computational Physics · Physics 2015-05-30 A S Richardson , J M Finn

We describe adaptive control algorithms whereby a chaotic dynamical system can be steered to a target state with desired characteristics. A specific implementation considered has the objective of directing the system to a state which is…

chao-dyn · Physics 2009-10-31 Ramakrishna Ramaswamy , Sudeshna Sinha , Neelima Gupte

This work focuses on the development of a new class of high-order accurate methods for multirate time integration of systems of ordinary differential equations. The proposed methods are based on a specific subset of explicit one-step…

Numerical Analysis · Mathematics 2019-04-16 Vu Thai Luan , Rujeko Chinomona , Daniel R. Reynolds

An adaptive proximal method for a special class of variational inequalities and related problems is proposed. For example, the so-called mixed variational inequalities and composite saddle problems are considered. Some estimates of the…

Optimization and Control · Mathematics 2020-08-25 Fedor S. Stonyakin

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

In this paper we combine two powerful computational techniques, well-tempered metadynamics and time lagged independent component analysis. The aim is to develop a new tool for studying rare events and exploring complex free energy…

Statistical Mechanics · Physics 2017-12-08 James McCarty , Michele Parrinello

In this work we propose a method to perform optimization on manifolds. We assume to have an objective function $f$ defined on a manifold and think of it as the potential energy of a mechanical system. By adding a momentum-dependent kinetic…

Numerical Analysis · Mathematics 2023-08-30 Marta Ghirardelli

We have presented some practical consequences on the molecular-dynamics simulations arising from the numerical algorithm published recently in paper Int. J. Mod. Phys. C 16, 413 (2005). The algorithm is not a finite-difference method and…

Exactly Solvable and Integrable Systems · Physics 2015-06-26 B. Brzostowski , M. R. Dudek , B. Grabiec , T. Nadzieja

We consider a class of stochastic gradient optimization schemes. Assuming that the objective function is strongly convex, we prove weak error estimates which are uniform in time for the error between the solution of the numerical scheme,…

Numerical Analysis · Mathematics 2026-01-27 Charles-Edouard Bréhier , Marc Dambrine , Nassim En-Nebbazi

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

Machine Learning · Statistics 2019-06-12 Nikolaos Gianniotis , Christoph Schnörr , Christian Molkenthin , Sanjay Singh Bora

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

We develop the structure theory for transformations of weakly geometric rough paths of bounded $1 < p$-variation and their controlled paths. Our approach differs from existing approaches as it does not rely on smooth approximations. We…

Classical Analysis and ODEs · Mathematics 2022-09-01 Thomas Cass , Bruce K. Driver , Christian Litterer , Emilio Ferrucci

We compute the integral of a function or the expectation of a random variable with minimal cost and use, for our new algorithm and for upper bounds of the complexity, i.i.d. samples. Under certain assumptions it is possible to select a…

Numerical Analysis · Mathematics 2018-10-24 Robert J. Kunsch , Erich Novak , Daniel Rudolf

Optimization methods have been broadly applied to two classes of objects viz. (i) modeling and description of data and (ii) the determination of the stationary points of functions. Here, a theoretical basis is developed that optimizes an…

Optimization and Control · Mathematics 2013-07-10 Christopher G. Jesudason