English
Related papers

Related papers: A Spectral Gradient Projection Method for the Posi…

200 papers

This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, the smooth and nonsmooth terms are dealt with by gradient and…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Wei Shi , Ming Yan

This paper considers a fractional programming problem (P) which minimizes a ratio of quadratic functions subject to a two-sided quadratic constraint. As is well-known, the fractional objective function can be replaced by a parametric family…

Optimization and Control · Mathematics 2014-02-19 Van-Bong Nguyen , Ruey-Lin Sheu , Yong Xia

Combining recent moment and sparse semidefinite programming (SDP) relaxation techniques, we propose an approach to find smooth approximations for solutions of problems involving nonlinear differential equations. Given a system of nonlinear…

Optimization and Control · Mathematics 2010-08-13 Martin Mevissen , Jean-Bernard Lasserre , Didier Henrion

Complex Semi-Definite Programming (SDP) is introduced as a novel approach to phase retrieval enabled control of monochromatic light transmission through highly scattering media. In a simple optical setup, a spatial light modulator is used…

In this paper, we propose a new non-monotone conjugate gradient method for solving unconstrained nonlinear optimization problems. We first modify the non-monotone line search method by introducing a new trigonometric function to calculate…

Optimization and Control · Mathematics 2022-11-15 Sajad Fathi Hafshejani , Daya Gaur , Shahadat Hossain , Robert Benkoczi

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

Blind super-resolution can be cast as a low rank matrix recovery problem by exploiting the inherent simplicity of the signal and the low dimensional structure of point spread functions. In this paper, we develop a simple yet efficient…

Information Theory · Computer Science 2022-11-23 Sihan Mao , Jinchi Chen

We present a novel optimization-based decoding algorithm for LDPC codes that is suitable for hardware architectures specialized to feed-forward neural networks. The algorithm is based on the projected gradient descent algorithm with a…

Information Theory · Computer Science 2019-01-16 Tadashi Wadayama , Satoshi Takabe

This paper introduces generalized Bregman projection algorithms for solving nonlinear split feasibility problems (SF P s) in infinitedimensional Hilbert spaces. The methods integrate Bregman projections, proximal gradient steps, and…

Optimization and Control · Mathematics 2025-05-20 Saeed Hashemi Sababe , Ehsan Lotfali Ghasab

In this paper, we study a class of fractional semi-infinite polynomial programming (FSIPP) problems, in which the objective is a fraction of a convex polynomial and a concave polynomial, and the constraints consist of infinitely many convex…

Optimization and Control · Mathematics 2021-05-18 Feng Guo , Liguo Jiao

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

This paper proposes low-complexity algorithms for finding approximate second-order stationary points (SOSPs) of problems with smooth non-convex objective and linear constraints. While finding (approximate) SOSPs is computationally…

Optimization and Control · Mathematics 2019-07-11 Songtao Lu , Meisam Razaviyayn , Bo Yang , Kejun Huang , Mingyi Hong

We consider the stochastic variational inequality problem in which the map is expectation-valued in a component-wise sense. Much of the available convergence theory and rate statements for stochastic approximation schemes are limited to…

Optimization and Control · Mathematics 2019-11-25 Aswin Kannan , Uday V. Shanbhag

Relying on the classical connection between Backward Stochastic Differential Equations (BSDEs) and non-linear parabolic partial differential equations (PDEs), we propose a new probabilistic learning scheme for solving high-dimensional…

Numerical Analysis · Mathematics 2021-02-25 Jean-François Chassagneux , Junchao Chen , Noufel Frikha , Chao Zhou

We propose a new stepsize for the gradient method. It is shown that this new stepsize will converge to the reciprocal of the largest eigenvalue of the Hessian, when Dai-Yang's asymptotic optimal gradient method (Computational Optimization…

Optimization and Control · Mathematics 2019-05-13 Yakui Huang , Yu-Hong Dai , Xin-Wei Liu , Hongchao Zhang

We employ chordal decomposition to reformulate a large and sparse semidefinite program (SDP), either in primal or dual standard form, into an equivalent SDP with smaller positive semidefinite (PSD) constraints. In contrast to previous…

Optimization and Control · Mathematics 2020-08-07 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou , Paul Goulart , Andrew Wynn

Motivated by recent work on atomic norms in inverse problems, we propose a new approach to line spectral estimation that provides theoretical guarantees for the mean-squared-error (MSE) performance in the presence of noise and without…

Information Theory · Computer Science 2013-02-19 Badri Narayan Bhaskar , Gongguo Tang , Benjamin Recht

The worst-case robust adaptive beamforming problem for general-rank signal model is considered. Its formulation is to maximize the worst-case signal-to-interference-plus-noise ratio (SINR), incorporating a positive semidefinite constraint…

Signal Processing · Electrical Eng. & Systems 2018-05-15 Yongwei Huang , Sergiy A. Vorobyov

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

In this paper, we present a new method to solve a certain type of Semidefinite Programming (SDP) problems. These types of SDPs naturally arise in the Quadratic Convex Reformulation (QCR) method and can be used to obtain dual bounds of…

Optimization and Control · Mathematics 2023-12-27 Apostolos Chalkis , Thomas Kleinert , Boro Sofranac