English
Related papers

Related papers: Sparse Inverse Problems Over Measures: Equivalence…

200 papers

Recently there has been an increasing interest in primal-dual methods for model predictive control (MPC), which require minimizing the (augmented) Lagrangian at each iteration. We propose a novel first order primal-dual method, termed…

Optimization and Control · Mathematics 2020-12-21 Yue Yu , Purnanand Elango , Behçet Açikmeşe

We propose an efficient semi-Lagrangian method for solving the two-dimensional incompressible Euler equations with high precision on a coarse grid. The new approach evolves the flow map using the gradient-augmented level set method (GALSM).…

Numerical Analysis · Mathematics 2023-02-21 Xi-Yuan Yin , Olivier Mercier , Badal Yadav , Kai Schneider , Jean-Christophe Nave

Semi-infinite programs are a class of mathematical optimization problems with a finite number of decision variables and infinite constraints. As shown by Blankenship and Falk (Blankenship and Falk. "Infinitely constrained optimization…

Optimization and Control · Mathematics 2020-09-21 Stuart M. Harwood , Dimitri J. Papageorgiou , Francisco Trespalacios

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

Equation discovery is a fundamental learning task for uncovering the underlying dynamics of complex systems, with wide-ranging applications in areas such as brain connectivity analysis, climate modeling, gene regulation, and physical…

Machine Learning · Computer Science 2026-01-29 Jiaqiang Li , Jianbin Tan , Xueqin Wang

Proximal gradient methods are popular in sparse optimization as they are straightforward to implement. Nevertheless, they achieve biased solutions, requiring many iterations to converge. This work addresses these issues through a suitable…

Optimization and Control · Mathematics 2025-04-18 V. Cerone , S. M. Fosson , A. Re , D. Regruto

Structured sparsity is an important modeling tool that expands the applicability of convex formulations for data analysis, however it also creates significant challenges for efficient algorithm design. In this paper we investigate the…

Optimization and Control · Mathematics 2014-10-20 Yaoliang Yu , Xinhua Zhang , Dale Schuurmans

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

We consider the preconditioned conjugate gradient method (PCG) with optimal preconditioner in the frame of the boundary element method (BEM) for elliptic first-kind integral equations. Our adaptive algorithm steers the termination of PCG as…

Numerical Analysis · Mathematics 2019-03-21 Thomas Führer , Alexander Haberl , Dirk Praetorius , Stefan Schimanko

With the growing prevalence of diabetes and the associated public health burden, it is crucial to identify modifiable factors that could improve patients' glycemic control. In this work, we seek to examine associations between medication…

Applications · Statistics 2025-12-22 Alexander Coulter , Rashmi N. Aurora , Naresh M. Punjabi , Irina Gaynanova

Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers…

Machine Learning · Computer Science 2022-02-09 Farshad G. Veshki , Sergiy A. Vorobyov

This paper can be seen as an attempt of rethinking the {\em Extra-Gradient Philosophy} for solving Variational Inequality Problems. We show that the properly defined {\em Reduced Gradients} can be used instead for finding approximate…

Optimization and Control · Mathematics 2023-12-05 Yurii Nesterov

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

Optimization and Control · Mathematics 2023-03-15 Lénaïc Chizat

This paper presents a novel algorithm that leverages Stochastic Gradient Descent strategies in conjunction with Random Features to augment the scalability of Conic Particle Gradient Descent (CPGD) specifically tailored for solving sparse…

Optimization and Control · Mathematics 2025-09-05 Yohann De Castro , Sébastien Gadat , Clément Marteau

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright

Graph matching is a challenging problem with very important applications in a wide range of fields, from image and video analysis to biological and biomedical problems. We propose a robust graph matching algorithm inspired in…

Optimization and Control · Mathematics 2013-11-26 Marcelo Fiori , Pablo Sprechmann , Joshua Vogelstein , Pablo Musé , Guillermo Sapiro

A general framework for solving image inverse problems is introduced in this paper. The approach is based on Gaussian mixture models, estimated via a computationally efficient MAP-EM algorithm. A dual mathematical interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2010-06-16 Guoshen Yu , Guillermo Sapiro , Stéphane Mallat

We develop subgradient- and gradient-based methods for minimizing strongly convex functions under a notion which generalizes the standard Euclidean strong convexity. We propose a unifying framework for subgradient methods which yields two…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito

We study the gradient Expectation-Maximization (EM) algorithm for Gaussian Mixture Models (GMM) in the over-parameterized setting, where a general GMM with $n>1$ components learns from data that are generated by a single ground truth…

Machine Learning · Computer Science 2025-06-03 Weihang Xu , Maryam Fazel , Simon S. Du