English
Related papers

Related papers: A Block Coordinate Descent Proximal Method for Sim…

200 papers

Belief Propagation (BP) followed by Ordered Statistics Decoding (OSD) has emerged as the gold standard for decoding quantum low-density parity-check (QLDPC) codes. Recent advancements in this field have proposed new methods and algorithms…

Information Theory · Computer Science 2026-05-26 Michele Banfi , Marco Ferrari , Antonino Favano , Alberto Tarable , Luca Barletta

We describe an asynchronous parallel stochastic proximal coordinate descent algorithm for minimizing a composite objective function, which consists of a smooth convex function plus a separable convex function. In contrast to previous…

Optimization and Control · Mathematics 2015-12-14 Ji Liu , Stephen J. Wright

This work considers the problem of computing the canonical polyadic decomposition (CPD) of large tensors. Prior works mostly leverage data sparsity to handle this problem, which is not suitable for handling dense tensors that often arise in…

Signal Processing · Electrical Eng. & Systems 2020-03-26 Xiao Fu , Shahana Ibrahim , Hoi-To Wai , Cheng Gao , Kejun Huang

This paper considers the joint transceiver design in a wireless sensor network where multiple sensors observe the same physical event and transmit their contaminated observations to a fusion center, with all nodes equipped with multiple…

Information Theory · Computer Science 2015-06-22 Yang Liu , Jing Li , Xuanxuan Lu , Chau Yuen

We propose a new stochastic coordinate descent method for minimizing the sum of convex functions each of which depends on a small number of coordinates only. Our method (APPROX) is simultaneously Accelerated, Parallel and PROXimal; this is…

Optimization and Control · Mathematics 2014-03-04 Olivier Fercoq , Peter Richtárik

In this paper, we propose a coverage control system for a multi-robot team with heterogeneous capabilities to patrol or monitor a bounded environment. The capability could be defined as any criterion of robots like remaining power or mobile…

Robotics · Computer Science 2022-04-22 Yung Yu Andy Yiu , Ying Hing Yim , Yan Ning , Zikai Wang , Ling Shi

We describe an asynchronous parallel stochastic coordinate descent algorithm for minimizing smooth unconstrained or separably constrained functions. The method achieves a linear convergence rate on functions that satisfy an essential strong…

Optimization and Control · Mathematics 2014-11-12 Ji Liu , Stephen J. Wright , Christopher Ré , Victor Bittorf , Srikrishna Sridhar

Nonconvex and nonsmooth problems have recently attracted considerable attention in machine learning. However, developing efficient methods for the nonconvex and nonsmooth optimization problems with certain performance guarantee remains a…

Optimization and Control · Mathematics 2019-02-07 Ehsan Kazemi , Liqiang Wang

We study the performance of medium-length quantum LDPC (QLDPC) codes in the depolarizing channel. Only degenerate codes with the maximal stabilizer weight much smaller than their minimum distance are considered. It is shown that with the…

Quantum Physics · Physics 2021-11-24 Pavel Panteleev , Gleb Kalachev

In this paper we propose a parallel coordinate descent algorithm for solving smooth convex optimization problems with separable constraints that may arise e.g. in distributed model predictive control (MPC) for linear network systems. Our…

Optimization and Control · Mathematics 2014-11-19 Ion Necoara , Dragos Clipici

In this paper, we propose a gradient-based block coordinate descent (BCD-G) framework to solve the joint approximate diagonalization of matrices defined on the product of the complex Stiefel manifold and the special linear group. Instead of…

Numerical Analysis · Mathematics 2023-04-26 Jianze Li , Konstantin Usevich , Pierre Comon

This article presents a powerful algorithmic framework for big data optimization, called the Block Successive Upper bound Minimization (BSUM). The BSUM includes as special cases many well-known methods for analyzing massive data sets, such…

Optimization and Control · Mathematics 2015-11-10 Mingyi Hong , Meisam Razaviyayn , Zhi-Quan Luo , Jong-Shi Pang

In this paper we propose a randomized primal-dual proximal block coordinate updating framework for a general multi-block convex optimization model with coupled objective function and linear constraints. Assuming mere convexity, we establish…

Optimization and Control · Mathematics 2017-01-25 Xiang Gao , Yangyang Xu , Shuzhong Zhang

We introduce two block coordinate descent algorithms for solving optimization problems with ordinary differential equations (ODEs) as dynamical constraints. The algorithms do not need to implement direct or adjoint sensitivity analysis…

Machine Learning · Computer Science 2022-08-30 Ion Matei , Maksym Zhenirovskyy , Johan de Kleer , John Maxwell

We propose a new multistep deep learning-based algorithm for the resolution of moderate to high dimensional nonlinear backward stochastic differential equations (BSDEs) and their corresponding parabolic partial differential equations (PDE).…

Numerical Analysis · Mathematics 2023-08-29 Daniel Bussell , Camilo Andrés García-Trillos

Pseudospectral approximation provides a means to approximate the dynamics of delay differential equations (DDE) by ordinary differential equations (ODE). This article develops a computer-aided algorithm to determine the distance between the…

Dynamical Systems · Mathematics 2024-05-14 Shane Kepley , Babette A. J. de Wolff

This paper introduces a coordinate descent version of the V\~u-Condat algorithm. By coordinate descent, we mean that only a subset of the coordinates of the primal and dual iterates is updated at each iteration, the other coordinates being…

Optimization and Control · Mathematics 2019-01-17 Olivier Fercoq , Pascal Bianchi

In this work we show that randomized (block) coordinate descent methods can be accelerated by parallelization when applied to the problem of minimizing the sum of a partially separable smooth convex function and a simple separable convex…

Optimization and Control · Mathematics 2013-11-27 Peter Richtárik , Martin Takáč

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

Novel coordinate descent (CD) methods are proposed for minimizing nonconvex functions consisting of three terms: (i) a continuously differentiable term, (ii) a simple convex term, and (iii) a concave and continuous term. First, by extending…

Optimization and Control · Mathematics 2019-09-15 Qi Deng , Chenghao Lan