中文
相关论文

相关论文: Parallel and Distributed Successive Convex Approxi…

200 篇论文

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

最优化与控制 · 数学 2022-11-21 Kaizhao Sun , X. Andy Sun

We propose a new asynchronous parallel block-descent algorithmic framework for the minimization of the sum of a smooth nonconvex function and a nonsmooth convex one, subject to both convex and nonconvex constraints. The proposed framework…

最优化与控制 · 数学 2018-04-02 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

We provide new results for noise-tolerant and sample-efficient learning algorithms under $s$-concave distributions. The new class of $s$-concave distributions is a broad and natural generalization of log-concavity, and includes many…

机器学习 · 统计学 2018-01-30 Maria-Florina Balcan , Hongyang Zhang

Support Vector Machines (SVM), a popular machine learning technique, has been applied to a wide range of domains such as science, finance, and social networks for supervised learning. Whether it is identifying high-risk patients by…

分布式、并行与集群计算 · 计算机科学 2014-06-20 Jeyanthi Narasimhan , Abhinav Vishnu , Lawrence Holder , Adolfy Hoisie

This paper investigates the collaboration of multiple connected and automated vehicles (CAVs) in different scenarios. In general, the collaboration of CAVs can be formulated as a nonlinear and nonconvex model predictive control (MPC)…

最优化与控制 · 数学 2022-07-26 Xiaoxue Zhang , Jun Ma , Zilong Cheng , Frank L. Lewis , Tong Heng Lee

The growing interest for high dimensional and functional data analysis led in the last decade to an important research developing a consequent amount of techniques. Parallelized algorithms, which consist in distributing and treat the data…

统计理论 · 数学 2017-10-24 Antoine Godichon-Baggioni , Sofiane Saadane

We present complexity and numerical results for a new asynchronous parallel algorithmic method for the minimization of the sum of a smooth nonconvex function and a convex nonsmooth regularizer, subject to both convex and nonconvex…

最优化与控制 · 数学 2017-01-23 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

Non-convex optimization is a critical tool in advancing machine learning, especially for complex models like deep neural networks and support vector machines. Despite challenges such as multiple local minima and saddle points, non-convex…

机器学习 · 计算机科学 2024-10-04 Greg B Fotopoulos , Paul Popovich , Nicholas Hall Papadopoulos

Stochastic convex optimization algorithms are the most popular way to train machine learning models on large-scale data. Scaling up the training process of these models is crucial, but the most popular algorithm, Stochastic Gradient Descent…

机器学习 · 统计学 2018-10-30 Ashok Cutkosky , Robert Busa-Fekete

In this paper we propose a parallel coordinate descent algorithm for solving smooth convex optimization problems with separable constraints that may arise e.g. in distributed model predictive control (MPC) for linear network systems. Our…

最优化与控制 · 数学 2014-11-19 Ion Necoara , Dragos Clipici

We propose a decomposition framework for the parallel optimization of the sum of a differentiable function and a (block) separable nonsmooth, convex one. The latter term is typically used to enforce structure in the solution as, for…

分布式、并行与集群计算 · 计算机科学 2013-11-12 Francisco Facchinei , Simone Sagratella , Gesualdo Scutari

This paper proposes a multi-scale method to design a continuous-time distributed algorithm for constrained convex optimization problems by using multi-agents with Markov switched network dynamics and noisy inter-agent communications. Unlike…

最优化与控制 · 数学 2021-03-02 Wei Ni , Xiaoli Wang

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

最优化与控制 · 数学 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

The scale of modern datasets necessitates the development of efficient distributed optimization methods for machine learning. We present a general-purpose framework for distributed computing environments, CoCoA, that has an efficient…

机器学习 · 计算机科学 2018-10-11 Virginia Smith , Simone Forte , Chenxin Ma , Martin Takac , Michael I. Jordan , Martin Jaggi

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

最优化与控制 · 数学 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz

The paper deals with stochastic difference-of-convex functions (DC) programs, that is, optimization problems whose the cost function is a sum of a lower semicontinuous DC function and the expectation of a stochastic DC function with respect…

数值分析 · 数学 2020-12-14 Le Thi Hoai An , Huynh Van Ngai , Pham Dinh Tao , Luu Hoang Phuc Hau

As a wide class of resource management problems in wireless communications are nonconvex and even NP-hard in many cases, finding globally optimal solutions to these problems is of little practical interest. Towards more pragmatic…

信息论 · 计算机科学 2017-04-17 Quang-Doanh Vu , Markku Juntti , Een-Kee Hong , Le-Nam Tran

This paper presents a Successive Convexification ($ \texttt{SCvx} $) algorithm to solve a class of non-convex optimal control problems with certain types of state constraints. Sources of non-convexity may include nonlinear dynamics and…

最优化与控制 · 数学 2017-10-23 Yuanqi Mao , Daniel Dueri , Michael Szmuk , Behçet Açıkmeşe

Distributed optimization is an essential paradigm to solve large-scale optimization problems in modern applications where big-data and high-dimensionality creates a computational bottleneck. Distributed optimization algorithms that exhibit…

系统与控制 · 电气工程与系统科学 2023-05-25 Aayushya Agarwal , Larry Pileggi

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

机器学习 · 计算机科学 2016-11-04 P Balamurugan , Francis Bach