English
Related papers

Related papers: An Algorithmic Framework of Variable Metric Over-R…

200 papers

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

Optimization and Control · Mathematics 2015-11-10 Dang Van Hieu

In this paper we propose distributed dual gradient algorithms for linearly constrained separable convex problems and analyze their rate of convergence under different assumptions. Under the strong convexity assumption on the primal…

Optimization and Control · Mathematics 2014-02-04 Ion Necoara , Valentin Nedelcu

This paper delves into an in-depth exploration of the Variable Projection (VP) algorithm, a powerful tool for solving separable nonlinear optimization problems across multiple domains, including system identification, image processing, and…

Optimization and Control · Mathematics 2025-01-08 Guangyong Chen , Peng Xue , Min Gan , Jing Chen , Wenzhong Guo , C. L. Philip. Chen

The Virtual Network Embedding Problem (VNEP) considers the efficient allocation of resources distributed in a substrate network to a set of request networks. Many existing works discuss either heuristics or exact algorithms, resulting in a…

Networking and Internet Architecture · Computer Science 2018-10-29 Elias Döhne

An application area of vertex enumeration problem (VEP) is the usage within objective space based linear/convex {vector} optimization algorithms whose aim is to generate (an approximation of) the Pareto frontier. In such algorithms, VEP,…

Optimization and Control · Mathematics 2020-10-30 Irfan Caner Kaya , Firdevs Ulus

We introduce a novel hybrid quantum-classical variational optimization method for unconstrained binary combinatorial optimization problems on gate-model quantum computers, integrating a custom variational ansatz, staged feedback-based dual…

In this paper, we introduce a \textit{Bi-level OPTimization} (BiOPT) framework for minimizing the sum of two convex functions, where both can be nonsmooth. The BiOPT framework involves two levels of methodologies. At the upper level of…

Optimization and Control · Mathematics 2021-07-14 Masoud Ahookhosh , Yurii Nesterov

The standard algorithms for solving large-scale convex-concave saddle point problems, or, more generally, variational inequalities with monotone operators, are proximal type algorithms which at every iteration need to compute a…

Optimization and Control · Mathematics 2014-06-24 Anatoli Juditsky , Arkadi Nemirovski

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

Methodology · Statistics 2016-12-23 Weidong Liu , Xi Luo

The performance of many network learning applications crucially hinges on the success of network embedding algorithms, which aim to encode rich network information into low-dimensional vertex-based vector representations. This paper…

Machine Learning · Computer Science 2019-10-01 Wenlin Wang , Chenyang Tao , Zhe Gan , Guoyin Wang , Liqun Chen , Xinyuan Zhang , Ruiyi Zhang , Qian Yang , Ricardo Henao , Lawrence Carin

Performance analysis of first-order algorithms with inexact oracles has gained recent attention due to various emerging applications in which obtaining exact gradients is impossible or computationally expensive. Previous research has…

Optimization and Control · Mathematics 2025-10-15 Yin Liu , Sam Davanloo Tajbakhsh

We introduce a relaxed-projection splitting algorithm for solving variational inequalities in Hilbert spaces for the sum of nonsmooth maximal monotone operators, where the feasible set is defined by a nonlinear and nonsmooth continuous…

Optimization and Control · Mathematics 2015-12-31 J. Y. Bello Cruz , R. Diaz Millan

Recently, minimax optimization received renewed focus due to modern applications in machine learning, robust optimization, and reinforcement learning. The scale of these applications naturally leads to the use of first-order methods.…

Optimization and Control · Mathematics 2023-03-07 Saeed Hajizadeh , Haihao Lu , Benjamin Grimmer

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

We study algorithms for the Submodular Multiway Partition problem (SubMP). An instance of SubMP consists of a finite ground set $V$, a subset of $k$ elements $S = \{s_1,s_2,...,s_k\}$ called terminals, and a non-negative submodular set…

Data Structures and Algorithms · Computer Science 2011-05-12 Chandra Chekuri , Alina Ene

It is known that adaptive optimization algorithms represent the key pillar behind the rise of the Machine Learning field. In the Optimization literature numerous studies have been devoted to accelerated gradient methods but only recently…

Optimization and Control · Mathematics 2024-02-02 Cristian Daniel Alecsa

We introduce an inertial quasi-Newton Forward-Backward Splitting Algorithm to solve a class of monotone inclusion problems. While the inertial step is computationally cheap, in general, the bottleneck is the evaluation of the resolvent…

Optimization and Control · Mathematics 2024-03-18 Shida Wang , Jalal Fadili , Peter Ochs

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

Minimizing training overhead in channel estimation is a crucial challenge in wireless communication systems. This paper presents an extension of the traditional blind algorithm, called "Mutually referenced equalizers" (MRE), specifically…

Signal Processing · Electrical Eng. & Systems 2024-04-16 Do Hai Son , Karim Abed-Meraim , Tran Trong Duy , Nguyen Linh Trung , Tran Thi Thuy Quynh