English
Related papers

Related papers: A robust, discrete-gradient descent procedure for …

200 papers

This paper deals with convex nonsmooth optimization problems. We introduce a general smooth approximation framework for the original function and apply random (accelerated) coordinate descent methods for minimizing the corresponding smooth…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

We present a numerical method for approximating the solutions of degenerate parabolic equations with a formal gradient flow structure. The numerical method we propose preserves at the discrete level the formal gradient flow structure,…

Analysis of PDEs · Mathematics 2016-02-11 Clément Cancès , Cindy Guichard

We develop randomized (block) coordinate descent (CD) methods for linearly constrained convex optimization. Unlike most CD methods, we do not assume the constraints to be separable, but let them be coupled linearly. To our knowledge, ours…

Optimization and Control · Mathematics 2015-06-11 Sashank Reddi , Ahmed Hefny , Carlton Downey , Avinava Dubey , Suvrit Sra

We propose a family of optimization methods that achieve linear convergence using first-order gradient information and constant step sizes on a class of convex functions much larger than the smooth and strongly convex ones. This larger…

Optimization and Control · Mathematics 2018-09-14 Chris J. Maddison , Daniel Paulin , Yee Whye Teh , Brendan O'Donoghue , Arnaud Doucet

Point discretization of curved surfaces is required in many applications ranging from object rendering to the solution of surface partial differential equations (PDEs). These applications often impose that surfaces are sampled with local…

Computational Engineering, Finance, and Science · Computer Science 2026-05-06 Lennart J. Schulze , Ivo F. Sbalzarini

We derive globally reliable a posteriori error estimators for a PDE-constrained optimization problem involving linear models in fluid dynamics as state equation; control constraints are also considered. The corresponding local error…

Numerical Analysis · Mathematics 2017-08-03 Alejandro Allendes , Enrique Otarola , Richard Rankin

We develop a numerical strategy to solve multi-dimensional Poisson equations on dynamically adapted grids for evolutionary problems disclosing propagating fronts. The method is an extension of the multiresolution finite volume scheme used…

Analysis of PDEs · Mathematics 2015-05-12 Max Duarte , Zdenek Bonaventura , Marc Massot , Anne Bourdon

We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose…

Optimization and Control · Mathematics 2025-01-22 Stephen P. Boyd , Tetiana Parshakova , Ernest K. Ryu , Jaewook J. Suh

In computational fluid dynamics, the demand for increasingly multidisciplinary reliable simulations, for both analysis and design optimization purposes, requires transformational advances in individual components of future solvers. At the…

Bilevel optimization is a fundamental tool in hierarchical decision-making and has been widely applied to machine learning tasks such as hyperparameter tuning, meta-learning, and continual learning. While significant progress has been made…

Optimization and Control · Mathematics 2025-04-25 Nazanin Abolfazli , Sina Sharifi , Mahyar Fazlyab , Erfan Yazdandoost Hamedani

Reconstructing PDE solutions from sparse observations is a core challenge in scientific computing. We present FM4PDE, a flow-matching generative framework that learns the joint distribution of PDE coefficients (or initial states) and…

Machine Learning · Statistics 2026-05-26 Xifeng Zhang , Jin Zhao

In this paper, we present a new control model for optimizing pressure and water quality operations in water distribution networks. Our formulation imposes a set of time-coupling constraints to manage temporal pressure variations, which are…

Optimization and Control · Mathematics 2024-09-24 Bradley Jenks , Aly-Joy Ulusoy , Filippo Pecci , Ivan Stoianov

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

Optimization and Control · Mathematics 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

A computational fluid dynamics code is differentiated using algorithmic differentiation (AD) in both tangent and adjoint modes. The two novelties of the present approach are 1) the adjoint code is obtained by letting the AD tool Tapenade…

Computational Physics · Physics 2020-07-10 J. I. Cardesa , L. Hascoët , C. Airiau

Stochastic gradient descent (SGD) is a simple and popular method to solve stochastic optimization problems which arise in machine learning. For strongly convex problems, its convergence rate was known to be O(\log(T)/T), by running SGD for…

Machine Learning · Computer Science 2015-03-19 Alexander Rakhlin , Ohad Shamir , Karthik Sridharan

We develop a continuous adjoint formulation and implementation for controlling the deformation of clean, neutrally buoyant droplets in Stokes flow through farfield velocity boundary conditions. The focus is on dynamics where surface tension…

Computational Physics · Physics 2024-02-23 Alexandru Fikl , Daniel J. Bodony

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

Recent advances in convex optimization have leveraged computer-assisted proofs to develop optimized first-order methods that improve over classical algorithms. However, each optimized method is specially tailored for a particular problem…

Optimization and Control · Mathematics 2025-07-01 Jinho Bok , Jason M. Altschuler