English
Related papers

Related papers: Parallel and Distributed Methods for Nonconvex Opt…

200 papers

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

Distributed stochastic non-convex optimization problems have recently received attention due to the growing interest of signal processing, computer vision, and natural language processing communities in applications deployed over…

Systems and Control · Electrical Eng. & Systems 2024-10-14 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ…

Optimization and Control · Mathematics 2020-03-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

We consider the problem of quantifying the Pareto optimal boundary in the achievable rate region over multiple-input single-output (MISO) interference channels, where the problem boils down to solving a sequence of convex feasibility…

Information Theory · Computer Science 2015-05-20 Jiaming Qiu , Rui Zhang , Zhi-Quan Luo , Shuguang Cui

We present a distributed solution to optimizing a convex function composed of several non-convex functions. Each non-convex function is privately stored with an agent while the agents communicate with neighbors to form a network. We show…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-19 Shripad Gade , Nitin H. Vaidya

We consider the system-wide utility maximization problem in the downlink of a cell-free massive multiple-input multiple-output (MIMO) system whereby a very large number of access points (APs) simultaneously serve a group of users.…

Signal Processing · Electrical Eng. & Systems 2020-09-22 Muhammad Farooq , Hien Quoc Ngo , Een-Kee Hong , Le-Nam Tran

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

Systems and Control · Computer Science 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

Majorization-minimization schemes are a broad class of iterative methods targeting general optimization problems, including nonconvex, nonsmooth and stochastic. These algorithms minimize successively a sequence of upper bounds of the…

Optimization and Control · Mathematics 2024-01-11 Daniela Lupu , Ion Necoara

In this paper, we propose a distributed algorithm for stochastic smooth, non-convex optimization. We assume a worker-server architecture where $N$ nodes, each having $n$ (potentially infinite) number of samples, collaborate with the help of…

Optimization and Control · Mathematics 2020-11-09 Pranay Sharma , Swatantra Kafle , Prashant Khanduri , Saikiran Bulusu , Ketan Rajawat , Pramod K. Varshney

In this paper, energy efficient power allocation for downlink massive MIMO systems is investigated. A constrained non-convex optimization problem is formulated to maximize the energy efficiency (EE), which takes into account the quality of…

Information Theory · Computer Science 2017-03-22 Jiadian Zhang , Yanxiang Jiang , Peng Li , Fuchun Zheng , Xiaohu You

In this paper, a multi-parameterized proximal point algorithm combining with a relaxation step is developed for solving convex minimization problem subject to linear constraints. We show its global convergence and sublinear convergence rate…

Numerical Analysis · Mathematics 2019-07-11 Jianchao Bai , Ke Guo , Xiaokai Chang

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

In this paper we study energy efficient joint power allocation and beamforming for coordinated multicell multiuser downlink systems. The considered optimization problem is in a non-convex fractional form and hard to tackle. We propose to…

Information Theory · Computer Science 2013-10-09 He Shiwen , Huang Yongming , Jin Shi , Yang Luxi

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving empirical risk minimization (ERM) problems with a nonsmooth regularization term. Our algorithm is applicable…

Machine Learning · Computer Science 2019-12-16 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

A two-user downlink network aided by a reconfigurable intelligent surface is considered. The weighted sum signal to interference plus noise ratio maximization and the sum rate maximization models are presented, where the precoding vectors…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Cong Sun , Xian Liu , Bile Peng , Eduard Jorswieck

We develop a novel and single-loop variance-reduced algorithm to solve a class of stochastic nonconvex-convex minimax problems involving a nonconvex-linear objective function, which has various applications in different fields such as…

Optimization and Control · Mathematics 2020-10-27 Quoc Tran-Dinh , Deyi Liu , Lam M. Nguyen

In this paper, we propose a novel algorithm to maximize the sum rate in interference-limited scenarios where each user decodes its own message with the presence of unknown interferences and noise considering the…

Information Theory · Computer Science 2015-03-23 Hussein Al-Shatri , Xiang Li , Rakash SivaSiva Ganesan , Anja Klein , Tobias Weber