English
Related papers

Related papers: Hamiltonian descent for composite objectives

200 papers

Energy minimization has been an intensely studied core problem in computer vision. With growing image sizes (2D and 3D), it is now highly desirable to run energy minimization algorithms in parallel. But many existing algorithms, in…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 K. S. Sesh Kumar , Alvaro Barbero , Stefanie Jegelka , Suvrit Sra , Francis Bach

We present a general convex relaxation approach to study a wide class of Unbalanced Optimal Transport problems for finite non-negative measures with possibly different masses. These are obtained as the lower semicontinuous and convex…

Optimization and Control · Mathematics 2024-01-02 Giuseppe Savaré , Giacomo Enrico Sodini

The study of convex functions - in particular, of their optimization (really minimization) is one of the most important fields of applied mathematics. Convexity seems to be one of those incredibly well-chosen hypotheses which is just…

Optimization and Control · Mathematics 2026-03-11 Eigil Fjeldgren Rischel

This paper revisits the well-studied fixed point problem from a unified viewpoint of mathematical modeling and canonical duality theory, i.e. the original problem is first reformulated as a nonconvex optimization problem, its well-posedness…

Optimization and Control · Mathematics 2018-01-29 Ning Ruan , David Yang Gao

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

With rapid advancements in machine learning, first-order algorithms have emerged as the backbone of modern optimization techniques, owing to their computational efficiency and low memory requirements. Recently, the connection between…

Quantum Physics · Physics 2025-05-21 Jiaqi Leng , Bin Shi

We introduce new global and local inexact oracle concepts for a wide class of convex functions in composite convex minimization. Such inexact oracles naturally come from primal-dual framework, barrier smoothing, inexact computations of…

Optimization and Control · Mathematics 2020-02-25 Tianxiao Sun , Ion Necoara , Quoc Tran-Dinh

This paper is devoted to the study of acceleration methods for an inequality constrained convex optimization problem by using Lyapunov functions. We first approximate such a problem as an unconstrained optimization problem by employing the…

Optimization and Control · Mathematics 2024-11-25 Juan Liu , Nan-Jing Huang , Xian-Jun Long , Xue-song Li

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

In this article we develop a new primal dual variational formulation suitable for a large class of non-convex problems in the calculus of variations. The results are obtained through basic tools of convex analysis, duality theory, the…

Optimization and Control · Mathematics 2019-09-05 Fabio Botelho

Using an optimization algorithm to solve a machine learning problem is one of mainstreams in the field of science. In this work, we demonstrate a comprehensive comparison of some state-of-the-art first-order optimization algorithms for…

Machine Learning · Computer Science 2014-04-29 Yu Wei , Pock Thomas

The relaxation in the calculus of variation motivates the numerical analysis of a class of degenerate convex minimization problems with non-strictly convex energy densities with some convexity control and two-sided $p$-growth. The…

Numerical Analysis · Mathematics 2024-07-03 C. Carstensen , N. T. Tran

This paper associates a dual problem to the minimization of an arbitrary linear perturbation of the robust sum function introduced in DOI 10.1007/s11228-019-00515-2. It provides an existence theorem for primal optimal solutions and, under…

Optimization and Control · Mathematics 2019-11-07 Nguyen Dinh , Miguel A. Goberna , Michel Volle

Attention to data-driven optimization approaches, including the well-known stochastic gradient descent method, has grown significantly over recent decades, but data-driven constraints have rarely been studied, because of the computational…

Machine Learning · Computer Science 2023-10-11 Shuoguang Yang , Xudong Li , Guanghui Lan

We consider a Beckmann formulation of an unbalanced optimal transport (UOT) problem. The $\Gamma$-convergence of this formulation of UOT to the corresponding optimal transport (OT) problem is established as the balancing parameter $\alpha$…

Numerical Analysis · Mathematics 2023-03-31 Zhe Xiong , Lei Li , Ya-Nan Zhu , Xiaoqun Zhang

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

We present two modified versions of the primal-dual splitting algorithm relying on forward-backward splitting proposed in \cite{vu} for solving monotone inclusion problems. Under strong monotonicity assumptions for some of the operators…

Optimization and Control · Mathematics 2013-03-13 Radu Ioan Bot , Ernö Robert Csetnek , Andre Heinrich

We present new results on optimization problems where the involved functions are evenly convex. By means of a generalized conjugation scheme and the perturbation theory introduced by Rockafellar, we propose an alternative dual problem for a…

Optimization and Control · Mathematics 2020-08-31 Maria Dolores Fajardo , Sorin-Mihai Grad , Jose Vidal

Conservation of energy is at the core of many physical phenomena and dynamical systems. There have been a significant number of works in the past few years aimed at predicting the trajectory of motion of dynamical systems using neural…

Machine Learning · Computer Science 2022-08-05 Yi Heng Lim , Muhammad Firmansyah Kasim

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou