English
Related papers

Related papers: Efficient proximal gradient algorithms for joint g…

200 papers

Recently, network lasso has drawn many attentions due to its remarkable performance on simultaneous clustering and optimization. However, it usually suffers from the imperfect data (noise, missing values etc), and yields sub-optimal…

Machine Learning · Computer Science 2018-08-21 Yawei Zhao , Kai Xu , Xinwang Liu , En Zhu , Xinzhong Zhu , Jianping Yin

In recent years, network models have gained prominence for their ability to capture complex associations. In statistical omics, networks can be used to model and study the functional relationships between genes, proteins, and other types of…

Methodology · Statistics 2023-06-21 Camilla Lingjærde , Sylvia Richardson

Graph matching is a fundamental tool in computer vision and pattern recognition. In this paper, we introduce an algorithm for graph matching based on the proximal operator, referred to as differentiable proximal graph matching (DPGM).…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Haoru Tan , Chuang Wang , Xu-Yao Zhang , Cheng-Lin Liu

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

One of the crucial issues in federated learning is how to develop efficient optimization algorithms. Most of the current ones require full device participation and/or impose strong assumptions for convergence. Different from the widely-used…

Optimization and Control · Mathematics 2023-09-26 Shenglong Zhou , Geoffrey Ye Li

The Graphical Lasso (GLasso) algorithm is fast and widely used for estimating sparse precision matrices (Friedman et al., 2008). Its central role in the literature of high-dimensional covariance estimation rivals that of Lasso regression…

Computation · Statistics 2024-03-20 Aramayis Dallakyan , Mohsen Pourahmadi

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

Systems and Control · Electrical Eng. & Systems 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

Graph signal processing deals with algorithms and signal representations that leverage graph structures for multivariate data analysis. Often said graph topology is not readily available and may be time-varying, hence (dynamic) graph…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Hector Chahuara , Gonzalo Mateos

The graphical lasso \citep{FHT2007a} is an algorithm for learning the structure in an undirected Gaussian graphical model, using $\ell_1$ regularization to control the number of zeros in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$…

Machine Learning · Statistics 2012-08-09 Rahul Mazumder , Trevor Hastie

Accelerated proximal gradient methods have recently been developed for solving quasi-static incremental problems of elastoplastic analysis with some different yield criteria. It has been demonstrated through numerical experiments that these…

Optimization and Control · Mathematics 2020-11-13 Yoshihiro Kanno

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

Pose graph optimization (PGO) is fundamental to robot perception and navigation systems, serving as the mathematical backbone for solving simultaneous localization and mapping (SLAM). Existing solvers suffer from polynomial growth in…

Optimization and Control · Mathematics 2026-01-23 Xin Chen , Chunfeng Cui , Deren Han , Liqun Qi

In this paper we consider from two different aspects the proximal alternating direction method of multipliers (ADMM) in Hilbert spaces. We first consider the application of the proximal ADMM to solve well-posed linearly constrained…

Optimization and Control · Mathematics 2023-10-11 Qinian Jin

Convolutional sparse representation (CSR), shift-invariant model for inverse problems, has gained much attention in the fields of signal/image processing, machine learning and computer vision. The most challenging problems in CSR implies…

Machine Learning · Computer Science 2020-11-23 Gustavo Silva , Paul Rodriguez

To solve the separable convex optimization problem with linear constraints, Eckstein and Bertsekas introduced the generalized alternating direction method of multipliers (in short, GADMM), which is an efficient and simple acceleration…

Optimization and Control · Mathematics 2022-11-17 Jianwen Peng , Dexi Liu , Xueqing Zhang , Jen-Chih Yao

In this paper, we propose decentralized and scalable algorithms for Gaussian process (GP) training and prediction in multi-agent systems. To decentralize the implementation of GP training optimization algorithms, we employ the alternating…

Machine Learning · Statistics 2022-03-08 George P. Kontoudis , Daniel J. Stilwell

In this paper, we explore two fundamental first-order algorithms in convex optimization, namely, gradient descent (GD) and proximal gradient method (ProxGD). Our focus is on making these algorithms entirely adaptive by leveraging local…

Optimization and Control · Mathematics 2024-02-13 Yura Malitsky , Konstantin Mishchenko

The proximal generalized alternating direction method of multipliers (p-GADMM) is substantially efficient for solving convex composite programming problems of high-dimensional to moderate accuracy. The global convergence of this method was…

Optimization and Control · Mathematics 2022-08-19 Han Wang , Yunhai Xiao

We consider the problem of decentralized composite optimization over a symmetric connected graph, in which each node holds its own agent-specific private convex functions, and communications are only allowed between nodes with direct links.…

Optimization and Control · Mathematics 2018-09-06 Bin Wang , Jun Fang , Huiping Duan , Hongbin Li