English
Related papers

Related papers: Analysis of an Adaptive Biasing Force method based…

200 papers

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina

We revisit a unified methodology for the iterative solution of nonlinear equations in Hilbert spaces. Our key observation is that the general approach from [Heid & Wihler, Math. Comp. 89 (2020), Calcolo 57 (2020)] satisfies an energy…

Numerical Analysis · Mathematics 2021-02-18 Pascal Heid , Dirk Praetorius , Thomas P. Wihler

Practical online learning tasks are often naturally defined on unconstrained domains, where optimal algorithms for general convex losses are characterized by the notion of comparator adaptivity. In this paper, we design such algorithms in…

Machine Learning · Computer Science 2022-10-13 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

In this paper, we study an ordinary differential equation with a degenerate global attractor at the origin, to which we add a white noise with a small parameter that regulates its intensity. Under general conditions, for any fixed…

Probability · Mathematics 2025-05-27 Gerardo Barrera , Conrado da Costa , Milton Jara

We analyze the dynamics of an online algorithm for independent component analysis in the high-dimensional scaling limit. As the ambient dimension tends to infinity, and with proper time scaling, we show that the time-varying joint empirical…

Machine Learning · Computer Science 2017-11-08 Chuang Wang , Yue M. Lu

The convergence and optimality of adaptive mixed finite element methods for the Poisson equation are established in this paper. The main difficulty for mixed finite element methods is the lack of minimization principle and thus the failure…

Numerical Analysis · Mathematics 2010-01-12 Long Chen , Michael Holst , Jinchao Xu

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

We determine the large size limit of a network of interacting Hawkes Processes on an adaptive network. The flipping of the node variables is taken to have an intensity given by the mean-field of the afferent edges and nodes. The flipping of…

Probability · Mathematics 2024-11-15 James MacLaurin

This paper develops and analyzes a stochastic derivative-free optimization strategy. A key feature is the state-dependent adaptive variance. We prove global convergence in probability with algebraic rate and give the quantitative results in…

Optimization and Control · Mathematics 2023-02-10 Björn Engquist , Kui Ren , Yunan Yang

This work is concerned with the development of a space-time adaptive numerical method, based on a rigorous a posteriori error bound, for a semilinear convection-diffusion problem which may exhibit blow-up in finite time. More specifically,…

Numerical Analysis · Mathematics 2015-02-12 Andrea Cangiani , Emmanuil H. Georgoulis , Irene Kyza , Stephen Metcalfe

Optimizing the learning rate remains a critical challenge in machine learning, essential for achieving model stability and efficient convergence. The Vector Auxiliary Variable (VAV) algorithm introduces a novel energy-based self-adjustable…

Machine Learning · Computer Science 2024-11-12 Jiahao Zhang , Christian Moya , Guang Lin

Sampling Gibbs measures at low temperatures is an important task but computationally challenging. Numerical evidence suggests that the infinite-swapping algorithm (isa) is a promising method. The isa can be seen as an improvement of the…

Probability · Mathematics 2021-09-21 Georg Menz , André Schlichting , Wenpin Tang , Tianqi Wu

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

We present a general framework of designing efficient dynamic approximate algorithms for optimization on undirected graphs. In particular, we develop a technique that, given any problem that admits a certain notion of vertex sparsifiers,…

Data Structures and Algorithms · Computer Science 2020-05-06 Li Chen , Gramoz Goranci , Monika Henzinger , Richard Peng , Thatchaphol Saranurak

Efficient numerical algorithm for stochastic differential equation has been an important object in the research of statistical physics and mathematics for a long time. In this paper we study the highly accurate numerical algorithm of the…

Statistical Mechanics · Physics 2023-08-28 De-Zhang Li , Xiao-Bao Yang

We propose an efficient novel path sampling-based framework designed to accelerate the investigation of rare events in complex molecular systems. A key innovation is the shift from sampling restricted path ensemble distributions, as in…

Chemical Physics · Physics 2025-03-28 Gianmarco Lazzeri , Peter G. Bolhuis , Roberto Covino

In adaptive-bias enhanced sampling methods, a bias potential is added to the system to drive transitions between metastable states. The bias potential is a function of a few collective variables and is gradually modified according to the…

Computational Physics · Physics 2022-05-30 Michele Invernizzi , Michele Parrinello

We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired…

Optimization and Control · Mathematics 2007-05-23 I. Y. Tyukin , D. V. Prokhorov , Cees van Leeuwen

We study the small-mass (overdamped) limit of Langevin equations for a particle in a potential and/or magnetic field with matrix-valued and state-dependent drift and diffusion. We utilize a bootstrapping argument to derive a hierarchy of…

Mathematical Physics · Physics 2020-05-05 Jeremiah Birrell , Jan Wehr

For a generalized Hodge Laplace equation, we prove the quasi-optimal convergence rate of an adaptive mixed finite element method. This adaptive method can control the error in the natural mixed variational norm when the space of harmonic…

Numerical Analysis · Mathematics 2021-03-02 Yuwen Li