English
Related papers

Related papers: Mirror Descent Algorithms for Minimizing Interacti…

200 papers

The assembly of proteins in membranes plays a key role in many crucial cellular pathways. Despite their importance, characterizing transmembrane assembly remains challenging for experiments and simulations. Equilibrium molecular dynamics…

Soft Condensed Matter · Physics 2024-08-05 Emil Jackel , Gianmarco Lazzeri , Roberto Covino

The minima of modern neural network loss functions are typically not isolated, rather they form connected components of reparameterization invariant solutions on the training data. Analytically characterizing these solutions is a hard…

Machine Learning · Computer Science 2026-05-18 Albert Kjøller Jacobsen , Leo Uhre Jakobsen , Johanna Marie Gegenfurtner , Georgios Arvanitidis

We consider the numerical computation of a variational problem that arises from materials science. The target functional is a type of elastic energy that is influenced by obstacles and adhesion. Owing to its strong nonlinearity and…

Numerical Analysis · Mathematics 2016-04-13 T. Kemmochi

Value iteration-type methods have been extensively studied for computing a nearly optimal value function in reinforcement learning (RL). Under a generative sampling model, these methods can achieve sharper sample complexity than policy…

Optimization and Control · Mathematics 2026-04-08 Zhichao Jia , Guanghui Lan

For the ITER-like wall, the JET mirror link divertor spectroscopy system was redesigned to fully cover the tungsten horizontal strike plate with faster time resolution and improved near-UV performance. Since the ITER-like wall project…

The aim of this paper is to deal with multi-physics simulation of micro-electro-mechanical systems (MEMS) based on an advanced numerical methodology. MEMS are very small devices in which electric as well as mechanical and fluid phenomena…

Other Computer Science · Computer Science 2007-11-29 V. Rochus , J. -C. Golinval , C. Louis , C. Mendez , I. Klapka

We study stochastic convex optimization under infinite noise variance. Specifically, when the stochastic gradient is unbiased and has uniformly bounded $(1+\kappa)$-th moment, for some $\kappa \in (0,1]$, we quantify the convergence rate of…

Machine Learning · Statistics 2022-02-24 Nuri Mert Vural , Lu Yu , Krishnakumar Balasubramanian , Stanislav Volgushev , Murat A. Erdogdu

The light damping hypothesis is usually assumed in structural dynamics since dissipative forces are in general weak with respect to inertial and elastic forces. In this paper a novel numerical method of time integration based on the…

Numerical Analysis · Mathematics 2025-04-01 Mario Lázaro

The numerical solution of parameter identification inverse problems for kinetic equations can exhibit high computational and memory costs. In this paper, we propose a dynamical low-rank scheme for the reconstruction of the scattering…

Numerical Analysis · Mathematics 2025-06-27 Lena Baumann , Lukas Einkemmer , Christian Klingenberg , Jonas Kusch

Gradient descent is a widely used iterative algorithm for finding local minima in multivariate functions. However, the final iterations often either overshoot the minima or make minimal progress, making it challenging to determine an…

Machine Learning · Computer Science 2024-10-28 Aviral Dhingra

We introduce two new particle-based algorithms for learning latent variable models via marginal maximum likelihood estimation, including one which is entirely tuning-free. Our methods are based on the perspective of marginal maximum…

Machine Learning · Statistics 2024-03-04 Louis Sharrock , Daniel Dodd , Christopher Nemeth

We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem…

Optimization and Control · Mathematics 2019-01-01 Le Thi Khanh Hien , Cuong V. Nguyen , Huan Xu , Canyi Lu , Jiashi Feng

We provide several applications of Optimistic Mirror Descent, an online learning algorithm based on the idea of predictable sequences. First, we recover the Mirror Prox algorithm for offline optimization, prove an extension to Holder-smooth…

Machine Learning · Computer Science 2013-11-11 Alexander Rakhlin , Karthik Sridharan

A new method is proposed to numerically integrate a dynamical system on a manifold such that the trajectory stably remains on the manifold and preserves first integrals of the system. The idea is that given an initial point in the manifold…

Numerical Analysis · Mathematics 2016-11-29 Dong Eui Chang , Fernando Jimenez , Matthew Perlmutter

Expectation maximization (EM) is the default algorithm for fitting probabilistic models with missing or latent variables, yet we lack a full understanding of its non-asymptotic convergence properties. Previous works show results along the…

Machine Learning · Computer Science 2022-03-01 Frederik Kunstner , Raunak Kumar , Mark Schmidt

This paper presents a comprehensive convergence analysis for the mirror descent (MD) method, a widely used algorithm in convex optimization. The key feature of this algorithm is that it provides a generalization of classical gradient-based…

Optimization and Control · Mathematics 2024-09-16 Mengmou Li , Khaled Laib , Takeshi Hatanaka , Ioannis Lestas

In this paper we consider online mirror descent (OMD) algorithms, a class of scalable online learning algorithms exploiting data geometric structures through mirror maps. Necessary and sufficient conditions are presented in terms of the…

Machine Learning · Computer Science 2019-12-16 Yunwen Lei , Ding-Xuan Zhou

In this paper we describe how imitative logit dynamic (rather popular in population games theory) can be interpreted in terms of mirror descent method (well known in convex optimization). We demonstrate the connection of this two type…

Optimization and Control · Mathematics 2016-05-03 Alexander Gasnikov , Anastasia Lagunovskaya , Larisa Morozova

The goal is to modify the known method of mirror descent (MD), proposed by A.S. Nemirovsky and D.B. Yudin in 1979. The paper shows the idea of a new, so-called inertial MD method with the example of a deterministic optimization problem in…

Optimization and Control · Mathematics 2017-05-03 Alexander Nazin

Feedback optimization is an increasingly popular control paradigm to optimize dynamical systems, accounting for control objectives that concern the system operation at steady-state. Existing feedback optimization techniques heavily rely on…

Optimization and Control · Mathematics 2025-04-08 Amir Mehrnoosh , Gianluca Bianchin