English
Related papers

Related papers: Nesterov's acceleration for level set-based topolo…

200 papers

This paper presents an educational code written using FEniCS, based on the level set method, to perform compliance minimization in structural optimization. We use the concept of distributed shape derivative to compute a descent direction…

Optimization and Control · Mathematics 2018-01-30 Laurain Antoine

We present a totally asynchronous algorithm for convex optimization that is based on a novel generalization of Nesterov's accelerated gradient method. This algorithm is developed for fast convergence under "total asynchrony," i.e., allowing…

Optimization and Control · Mathematics 2024-06-17 Ellie Pond , April Sebok , Zachary Bell , Matthew Hale

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

Various distributed gradient descent algorithms for multi-agent optimization have incorporated the Nesterov accelerated gradient method, where the use of momentum enhances convergence rates. These algorithms have found broad applications in…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Zihao Ren , Lei Wang , Guodong Shi

We present a unifying framework for adapting the update direction in gradient-based iterative optimization methods. As natural special cases we re-derive classical momentum and Nesterov's accelerated gradient method, lending a new intuitive…

Machine Learning · Statistics 2016-07-12 Aleksandar Botev , Guy Lever , David Barber

In this paper we use memory-distributed level set-based topology optimisation to design three-dimensional periodic piezoelectric materials with enhanced properties. We compare and assess several existing iterative solvers with respect to…

Computational Engineering, Finance, and Science · Computer Science 2026-01-26 Zachary J. Wegert , Anthony P. Roberts , Vivien J. Challis

Lookahead-based acceleration methods, such as Nesterov's momentum, are widely used in optimization, but they often become unreliable in deep learning training mainly due to stochastic gradient noise and non-convex loss landscapes. In…

Machine Learning · Computer Science 2026-05-26 Chung-Yiu Yau , Dawei Li , Athanasios Glentis , Valentyn Boreiko , Hoi-To Wai , Mingyi Hong

Topological optimization finds a material density distribution minimizing a functional of the solution of a partial differential equation (PDE), subject to a set of constraints (typically, a bound on the volume or mass of the material).…

Numerical Analysis · Mathematics 2017-05-23 G. V. Ovchinnikov , D. Zorin , I. V. Oseledets

We present a general and scalable framework for the automated discovery of optimal meta-solvers for the solution of time-dependent nonlinear partial differential equations after appropriate discretization. By integrating classical numerical…

Numerical Analysis · Mathematics 2025-07-02 Youngkyu Lee , Shanqing Liu , Jerome Darbon , George Em Karniadakis

In this paper we will consider distributed Linear-Quadratic Optimal Control Problems dealing with Advection-Diffusion PDEs for high values of the P\'eclet number. In this situation, computational instabilities occur, both for steady and…

Numerical Analysis · Mathematics 2024-05-03 Fabio Zoccolan , Maria Strazzullo , Gianluigi Rozza

We study a higher-order surface finite element (SFEM) penalty-based discretization of the tangential surface Stokes problem. Several discrete formulations are investigated which are equivalent in the continuous setting. The impact of the…

Numerical Analysis · Mathematics 2025-03-11 Hanne Hardering , Simon Praetorius

We consider an inverse problem involving the reconstruction of the solution to a nonlinear partial differential equation (PDE) with unknown boundary conditions. Instead of direct boundary data, we are provided with a large dataset of…

Numerical Analysis · Mathematics 2025-07-30 Erik Burman , Mats G. Larson , Karl Larsson , Carl Lundholm

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

A novel finite element framework is proposed for the numerical simulation of two phase flows with surface tension. The Level-Set (LS) method with piece-wise quadratic (P2) interpolation for the liquid-gas interface is used in order to reach…

Computational Engineering, Finance, and Science · Computer Science 2020-10-27 Modesar Shakoor , Chung Hae Park

Petrov-Galerkin formulations with optimal test functions allow for the stabilization of finite element simulations. In particular, given a discrete trial space, the optimal test space induces a numerical scheme delivering the best…

Numerical Analysis · Mathematics 2023-05-17 Tomasz Sluzalec , Mateusz Dobija , Anna Paszynska , Ignacio Muga , Maciej Paszynski

We propose a new algorithm for the design of topologically optimized lightweight structures, under a minimum compliance requirement. The new process enhances a standard level set formulation in terms of computational efficiency, thanks to…

Computational Engineering, Finance, and Science · Computer Science 2022-08-24 Davide Cortellessa , Nicola Ferro , Simona Perotto , Stefano Micheletti

We develop a generalization of Nesterov's accelerated gradient descent method which is designed to deal with orthogonality constraints. To demonstrate the effectiveness of our method, we perform numerical experiments which demonstrate that…

Optimization and Control · Mathematics 2021-01-07 Jonathan W. Siegel

In this technical note, we are concerned with the problem of solving variational inequalities with improved convergence rates. Motivated by Nesterov's accelerated gradient method for convex optimization, we propose a Nesterov's accelerated…

Optimization and Control · Mathematics 2022-12-21 Shaolin Tan , Jinhu Lu

The work explores a specific scenario for structural computational optimization based on the following elements: (a) a relaxed optimization setting considering the ersatz (bi-material) approximation, (b) a treatment based on a nonsmoothed…

Computational Engineering, Finance, and Science · Computer Science 2021-08-06 J. Oliver , D. Yago , J. Cante , O. Lloberas-Valls

We present a Pseudo-Transient Topology Optimization (PeTTO) approach that can leverage graphics processing units (GPUs) to efficiently solve single-material and multi-material topology optimization problems. By integrating PeTTO with phase…

Numerical Analysis · Mathematics 2025-09-10 Mingyuan Yang , Qian Yu , Chao Yang