English
Related papers

Related papers: Convex Optimization with an Interpolation-based Pr…

200 papers

In this paper, we studied the equilibrium problem where the bi-function may be quasiconvex with respect to the second variable and the feasible set is the intersection of a finite number of convex sets. We propose a projection-algorithm,…

Optimization and Control · Mathematics 2020-10-02 Le Hai Yen , Le Dung Muu

Locating proximal points is a component of numerous minimization algorithms. This work focuses on developing a method to find the proximal point of a convex function at a point, given an inexact oracle. Our method assumes that exact…

Optimization and Control · Mathematics 2016-11-03 Warren Hare , Chayne Planiden

Training convolutional neural networks at scale demands substantial memory, largely due to storing intermediate activations for backpropagation. Existing approaches -- such as checkpointing, invertible architectures, or gradient…

Machine Learning · Computer Science 2026-03-11 Anirudh Thatipelli , Jeffrey Sam , Mathias Louboutin , Ali Siahkoohi , Rongrong Wang , Felix J. Herrmann

Constrained Optimization solution algorithms are restricted to point based solutions. In practice, single or multiple objectives must be satisfied, wherein both the objective function and constraints can be non-convex resulting in multiple…

Neural and Evolutionary Computing · Computer Science 2021-01-05 Gurpreet Singh , Soumyajit Gupta , Matthew Lease

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

We present a nonlinear interpolation technique for parametric fields that exploits optimal transportation of coherent structures of the solution to achieve accurate performance. The approach generalizes the nonlinear interpolation procedure…

Numerical Analysis · Mathematics 2023-10-09 Simona Cucchiara , Angelo Iollo , Tommaso Taddei , Haysam Telib

Any solid object can be decomposed into a collection of convex polytopes (in short, convexes). When a small number of convexes are used, such a decomposition can be thought of as a piece-wise approximation of the geometry. This…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Boyang Deng , Kyle Genova , Soroosh Yazdani , Sofien Bouaziz , Geoffrey Hinton , Andrea Tagliasacchi

We propose a new framework for black-box convex optimization which is well-suited for situations where gradient computations are expensive. We derive a new method for this framework which leverages several concepts from convex optimization,…

Optimization and Control · Mathematics 2016-02-17 Sébastien Bubeck , Yin-Tat Lee

It is often possible to perform reduced order modelling by specifying linear subspace which accurately captures the dynamics of the system. This approach becomes especially appealing when linear subspace explicitly depends on parameters of…

Machine Learning · Computer Science 2026-04-17 Vladimir Fanaskov , Vladislav Trifonov , Alexander Rudikov , Ekaterina Muravleva , Ivan Oseledets

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

This paper presents new projection-free algorithms for Online Convex Optimization (OCO) over a convex domain $\mathcal{K} \subset \mathbb{R}^d$. Classical OCO algorithms (such as Online Gradient Descent) typically need to perform Euclidean…

Optimization and Control · Mathematics 2023-06-21 Khashayar Gatmiry , Zakaria Mhammedi

Most deep learning methods for video frame interpolation consist of three main components: feature extraction, motion estimation, and image synthesis. Existing approaches are mainly distinguishable in terms of how these modules are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Moritz Nottebaum , Stefan Roth , Simone Schaub-Meyer

Many high-dimensional optimisation problems exhibit rich geometric structures in their set of minimisers, often forming smooth manifolds due to over-parametrisation or symmetries. When this structure is known, at least locally, it can be…

Optimization and Control · Mathematics 2025-10-27 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

In multi-objective optimization, computing the entire non-dominated set (also known as the Pareto front or the Pareto frontier) is often intractable. However, for any multiplicative factor greater than one, an approximation set can be…

Optimization and Control · Mathematics 2026-04-30 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

Consider a dataset of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called REAPER,…

Information Theory · Computer Science 2015-07-24 Gilad Lerman , Michael McCoy , Joel A. Tropp , Teng Zhang

We use Deep Operator Networks (DeepONets) to perform super-resolution reconstruction of the solutions of two types of partial differential equations and compare the model predictions with the results obtained using conventional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Siyuan Yang

In this paper, we present difference of convex algorithms for solving bilevel programs in which the upper level objective functions are difference of convex functions, and the lower level programs are fully convex. This nontrivial class of…

Optimization and Control · Mathematics 2022-08-30 Jane J. Ye , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

This paper considers decentralized optimization of convex functions with mixed affine equality constraints involving both local and global variables. Constraints on global variables may vary across different nodes in the network, while…

Optimization and Control · Mathematics 2026-02-05 Demyan Yarmoshik , Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov