English
Related papers

Related papers: Log-Averaged Mirror Prox for Fast, Large-Scale Opt…

200 papers

This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the…

Optimization and Control · Mathematics 2025-06-03 James K. Alcala , Yat Tin Chow , Mahesh Sunkula

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

Optimization and Control · Mathematics 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

We study the complexity of approximating the multimarginal optimal transport (MOT) distance, a generalization of the classical optimal transport distance, considered here between $m$ discrete probability distributions supported each on $n$…

Machine Learning · Statistics 2022-02-23 Tianyi Lin , Nhat Ho , Marco Cuturi , Michael I. Jordan

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

Object-level Simultaneous Localization and Mapping (SLAM), which incorporates semantic information for high-level scene understanding, faces challenges of under-constrained optimization due to sparse observations. Prior work has introduced…

Robotics · Computer Science 2025-09-29 Yang Jiao , Yiding Qiu , Henrik I. Christensen

Despite major advancements in nonlinear programming (NLP) and convex relaxations, most system operators around the world still predominantly use some form of linear programming (LP) approximation of the AC power flow equations. This is…

Optimization and Control · Mathematics 2021-07-19 Sleiman , Mhanna , Pierluigi , Mancarella

In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an…

Optimization and Control · Mathematics 2021-06-30 Xin He , Rong Hu , Ya-Ping Fang

Massively parallel simulations of transport equation systems call for a paradigm change in algorithm development to achieve efficient scalability. Traditional approaches require time synchronization of processing elements (PEs) which…

Computational Physics · Physics 2017-09-28 Ankita Mittal , Sharath Girimaji

Optimization has been widely used to generate smooth trajectories for motion planning. However, existing trajectory optimization methods show weakness when dealing with large-scale long trajectories. Recent advances in parallel computing…

Robotics · Computer Science 2025-07-18 Jiajun Yu , Nanhe Chen , Guodong Liu , Chao Xu , Fei Gao , Yanjun Cao

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

Optimization and Control · Mathematics 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

Real-world instructional videos are long, noisy, and often contain extended background segments, repeated actions, and execution variability that do not correspond to meaningful procedural steps. We propose **REMAP**, an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Soumyadeep Chandra , Kaushik Roy

We rephrase Monge's optimal transportation (OT) problem with quadratic cost--via a Monge-Amp\`ere equation--as an infinite-dimensional optimization problem, which is in fact a convex problem when the target is a log-concave measure with…

Numerical Analysis · Mathematics 2017-08-29 Michael Lindsey , Yanir A. Rubinstein

In this article, we dwell into the class of so-called ill-posed Linear Inverse Problems (LIP) which simply refers to the task of recovering the entire signal from its relatively few random linear measurements. Such problems arise in a…

Optimization and Control · Mathematics 2022-12-05 Mohammed Rayyan Sheriff , Debasish Chatterjee

Recent advancements in data science have significantly elevated the importance of orthogonally constrained optimization problems. The Riemannian approach has become a popular technique for addressing these problems due to the advantageous…

Optimization and Control · Mathematics 2026-04-07 Linglingzhi Zhu , Wentao Ding , Shangyuan Liu , Anthony Man-Cho So

This paper considers stochastic optimization problems with weakly convex objective and constraint functions. We propose Prox-PEP, a proximal method equipped with quadratic subproblems. To handle nonlinear equality constraints, we employ an…

Optimization and Control · Mathematics 2026-05-11 Lixin Tang , Xingyu Wang , Liwei Zhang

An universal primal-dual approach of description equilibriums in large class of hierarchical congestion population games is proposed. At the very core of the approach is hierarchy of enclosed to each other transport networks. In different…

Optimization and Control · Mathematics 2016-03-09 Alexander Gasnikov , Evgenia Gasnikova , Sergey Matsievsky , Inna Usik

We propose a new self-adaptive, double-loop smoothing algorithm to solve composite, nonsmooth, and constrained convex optimization problems. Our algorithm is based on Nesterov's smoothing technique via general Bregman distance functions. It…

Optimization and Control · Mathematics 2018-08-15 Quoc Tran-Dinh , Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

Optimization and Control · Mathematics 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

Computation and Language · Computer Science 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien