English
Related papers

Related papers: Inexact Model: A Framework for Optimization and Va…

200 papers

Constrained non-convex optimization is fundamentally challenging, as global solutions are generally intractable and constraint qualifications may not hold. However, in many applications, including safe policy optimization in control and…

Optimization and Control · Mathematics 2025-11-14 Ilyas Fatkhullin , Niao He , Guanghui Lan , Florian Wolf

Optimization is a ubiquitous modeling tool and is often deployed in settings which repeatedly solve similar instances of the same problem. Amortized optimization methods use learning to predict the solutions to problems in these settings,…

Machine Learning · Computer Science 2025-10-07 Brandon Amos

This paper puts forth a new formulation and algorithm for the elastic matching problem on unparametrized curves and surfaces. Our approach combines the frameworks of square root normal fields and varifold fidelity metrics into a novel…

Differential Geometry · Mathematics 2019-03-05 Martin Bauer , Nicolas Charon , Philipp Harms

In this paper we present an inexact proximal point method for variational inequality problem on Hadamard manifolds and study its convergence properties. The proposed algorithm is inexact in two sense. First, each proximal subproblem is…

Optimization and Control · Mathematics 2021-03-04 G. C. Bento , O. P. Ferreira , E. A. Papa Quiroz

Motivated by robust matrix recovery problems such as Robust Principal Component Analysis, we consider a general optimization problem of minimizing a smooth and strongly convex loss function applied to the sum of two blocks of variables,…

Machine Learning · Computer Science 2019-11-19 Dan Garber , Shoham Sabach , Atara Kaplan

An adaptive regularization algorithm using inexact function and derivatives evaluations is proposed for the solution of composite nonsmooth nonconvex optimization. It is shown that this algorithm needs at most…

Optimization and Control · Mathematics 2019-02-28 S. Gratton , E. Simon , Ph. L. Toint

Large-scale constrained optimization problems are at the core of many tasks in control, signal processing, and machine learning. Notably, problems with functional constraints arise when, beyond a performance{\nobreakdash-}centric goal…

Optimization and Control · Mathematics 2025-05-15 Antesh Upadhyay , Sang Bin Moon , Abolfazl Hashemi

In this paper, acceleration of gradient methods for convex optimization problems with weak levels of convexity and smoothness is considered. Starting from the universal fast gradient method which was designed to be an optimal method for…

Optimization and Control · Mathematics 2022-06-10 Jongho Park

In this paper, we propose a proximal gradient method and an accelerated proximal gradient method for solving composite optimization problems, where the objective function is the sum of a smooth and a convex, possibly nonsmooth, function. We…

Optimization and Control · Mathematics 2025-07-22 Raghu Bollapragada , Shagun Gupta

Error bounds, which refer to inequalities that bound the distance of vectors in a test set to a given set by a residual function, have proven to be extremely useful in analyzing the convergence rates of a host of iterative methods for…

Optimization and Control · Mathematics 2015-12-14 Zirui Zhou , Anthony Man-Cho So

The main goal of this paper is to present the application of a superiorization methodology to solution of variational inequalities. Within this framework a variational inequality operator is considered as a small perturbation of a convex…

Optimization and Control · Mathematics 2016-11-30 Evgeni Nurminski

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the…

Optimization and Control · Mathematics 2012-07-16 Radu Ioan Bot , Christopher Hendrich

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

Optimization and Control · Mathematics 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

This work is concerned with the optimization of nonconvex, nonsmooth composite optimization problems, whose objective is a composition of a nonlinear mapping and a nonsmooth nonconvex function, that can be written as an infimal convolution…

Optimization and Control · Mathematics 2018-03-28 Emanuel Laude , Daniel Cremers

In the framework of solid mechanics, the task of deriving material parameters from experimental data has recently re-emerged with the progress in full-field measurement capabilities and the renewed advances of machine learning. In this…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Ulrich Römer , Stefan Hartmann , Jendrik-Alexander Tröger , David Anton , Henning Wessels , Moritz Flaschel , Laura De Lorenzis

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

We present a model-based derivative-free method for optimization subject to general convex constraints, which we assume are unrelaxable and accessed only through a projection operator that is cheap to evaluate. We prove global convergence…

Optimization and Control · Mathematics 2022-03-18 Matthew Hough , Lindon Roberts

We consider variational inequalities coming from monotone operators, a setting that includes convex minimization and convex-concave saddle-point problems. We assume an access to potentially noisy unbiased values of the monotone operators…

Machine Learning · Computer Science 2019-02-06 Francis Bach , Kfir Y. Levy

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov