English
Related papers

Related papers: First-Order Geometry, Spectral Compression, and St…

200 papers

We propose a variational framework for accretive surface growth driven by an optimality principle. Rather than prescribing a kinetic law, the configuration at each time step is obtained, within a time-discrete setting, as the solution of a…

Mathematical Physics · Physics 2026-05-14 Rohan Abeyaratne , Roberto Paroni , Marco Picchi Scardaoni

In this paper, we propose a unifying framework incorporating several momentum-related search directions for solving strongly monotone variational inequalities. The specific combinations of the search directions in the framework are made to…

Optimization and Control · Mathematics 2021-03-30 Kevin Huang , Shuzhong Zhang

The gradient mapping norm is a strong and easily verifiable stopping criterion for first-order methods on composite problems. When the objective exhibits the quadratic growth property, the gradient mapping norm minimization problem can be…

Optimization and Control · Mathematics 2024-10-31 Mihai I. Florea

We present a geometric multilevel optimization approach that smoothly incorporates box constraints. Given a box constrained optimization problem, we consider a hierarchy of models with varying discretization levels. Finer models are…

Optimization and Control · Mathematics 2024-04-23 Sebastian Müller , Stefania Petra , Matthias Zisler

We consider a class of convex optimization problems over the simplex of probability measures. Our framework comprises optimal experimental design (OED) problems, in which the measure over the design space indicates which experiments are…

Numerical Analysis · Mathematics 2020-04-20 Roland Herzog , Eric Legler

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

First-order methods with momentum such as Nesterov's fast gradient method are very useful for convex optimization problems, but can exhibit undesirable oscillations yielding slow convergence rates for some applications. An adaptive…

Optimization and Control · Mathematics 2019-06-14 Donghwan Kim , Jeffrey A. Fessler

Conditional gradients constitute a class of projection-free first-order algorithms for smooth convex optimization. As such, they are frequently used in solving smooth convex optimization problems over polytopes, for which the computational…

Optimization and Control · Mathematics 2019-10-14 Jelena Diakonikolas , Alejandro Carderera , Sebastian Pokutta

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed graph structure, and…

Machine Learning · Computer Science 2013-09-27 Kiyohito Nagano , Yoshinobu Kawahara

In this paper we theoretically show that interior-point methods based on self-concordant barriers possess favorable global complexity beyond their standard application area of convex optimization. To do that we propose first- and…

Optimization and Control · Mathematics 2024-04-30 Pavel Dvurechensky , Mathias Staudigl

This work deals with the presence of topological structures in models of two real scalar fields in the two-dimensional spacetime. The subject concerns the presence of a geometric constriction, which appears with a modification of the…

High Energy Physics - Theory · Physics 2024-03-11 D. Bazeia , M. A. Feitosa , R. Menezes , G. S. Santiago

This paper is devoted to studying the first-order variational analysis of non-convex and non-differentiable functions that may not be subdifferentially regular. To achieve this goal, we entirely rely on two concepts of directional…

Optimization and Control · Mathematics 2022-04-22 Ashkan Mohammadi

In this work, we present an efficient gradient projection method for solving a class of stochastic optimal control problem with expected integral state constraint. The first order optimality condition system consisting of forward-backward…

Optimization and Control · Mathematics 2024-12-24 Qiming Wang , Wenbin Liu

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding…

Optimization and Control · Mathematics 2017-06-21 Jérôme Bolte , Shoham Sabach , Marc Teboulle , Yakov Vaisbourd

In this paper, we study a class of deterministically constrained stochastic optimization problems. Existing methods typically aim to find an $\epsilon$-stochastic stationary point, where the expected violations of both constraints and…

Optimization and Control · Mathematics 2025-09-03 Zhaosong Lu , Sanyou Mei , Yifeng Xiao

Several variants of the Constraint Satisfaction Problem have been proposed and investigated in the literature for modelling those scenarios where solutions are associated with some given costs. Within these frameworks computing an optimal…

Artificial Intelligence · Computer Science 2012-09-18 Georg Gottlob , Gianluigi Greco , Francesco Scarcello

We consider a wide range of regularized stochastic minimization problems with two regularization terms, one of which is composed with a linear function. This optimization model abstracts a number of important applications in artificial…

Machine Learning · Computer Science 2018-02-02 Tianyi Lin , Linbo Qiao , Teng Zhang , Jiashi Feng , Bofeng Zhang

The variation of spectral subspaces for linear self-adjoint operators under an additive bounded perturbation is considered. The objective is to estimate the norm of the difference of two spectral projections associated with isolated parts…

Spectral Theory · Mathematics 2022-02-02 Albrecht Seelmann

Direct methods for the simulation of optimal control problems apply a specific discretization to the dynamics of the problem, and the discrete adjoint method is suitable to calculate corresponding conditions to approximate an optimal…

We introduce the concept of inexact first-order oracle of degree q for a possibly nonconvex and nonsmooth function, which naturally appears in the context of approximate gradient, weak level of smoothness and other situations. Our…

Optimization and Control · Mathematics 2024-01-22 Yassine Nabou , Francois Glineur , Ion Necoara