English
Related papers

Related papers: Distributed Radar Imaging Based on Accelerated ADM…

200 papers

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

Machine Learning · Computer Science 2016-10-18 Shuai Zheng , James T. Kwok

To meet the ever growing demand for both high throughput and uniform coverage in future wireless networks, dense network deployment will be ubiquitous, for which co- operation among the access points is critical. Considering the…

Information Theory · Computer Science 2014-05-14 Yuanming Shi , Jun Zhang , Khaled B. Letaief

In this two-part work, we propose an algorithmic framework for solving non-convex problems whose objective function is the sum of a number of smooth component functions plus a convex (possibly non-smooth) or/and smooth (possibly non-convex)…

Optimization and Control · Mathematics 2019-07-24 Sandeep Kumar , Ketan Rajawat , Daniel P. Palomar

So far, the problem of unmixing large or multitemporal hyperspectral datasets has been specifically addressed in the remote sensing literature only by a few dedicated strategies. Among them, some attempts have been made within a distributed…

Image and Video Processing · Electrical Eng. & Systems 2018-10-22 Pierre-Antoine Thouvenin , Nicolas Dobigeon , Jean-Yves Tourneret

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

Optimization and Control · Mathematics 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

Optimization and Control · Mathematics 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

Optimization and Control · Mathematics 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

In this paper, we design low correlation binary sequences favorable in wireless communication and radar applications. First, we formulate the designing problem as a nonconvex combination optimization problem with flexible correlation…

Signal Processing · Electrical Eng. & Systems 2021-10-07 Jiangtao Wang , Yongchao Wang

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form $\min\{f(x)+g(y) : Ax+By=c\}$. ADMM exhibits robust empirical performance across a range of…

Optimization and Control · Mathematics 2024-02-08 Rina Foygel Barber , Emil Y. Sidky

Masked diffusion models (MDMs) have emerged as a promising approach for language modeling, yet they face a performance gap compared to autoregressive models (ARMs) and require more training iterations. In this work, we present the…

Machine Learning · Computer Science 2026-01-26 Mahdi Karami , Ali Ghodsi

Distributed radio interferometric calibration based on consensus optimization has been shown to improve the estimation of systematic errors in radio astronomical observations. The intrinsic continuity of systematic errors across frequency…

Instrumentation and Methods for Astrophysics · Physics 2017-10-17 Sarod Yatawatta , Faruk Diblen , Hanno Spreeuw

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

Optimization and Control · Mathematics 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

We develop a new consensus-based distributed algorithm for solving learning problems with feature partitioning and non-smooth convex objective functions. Such learning problems are not separable, i.e., the associated objective functions…

Signal Processing · Electrical Eng. & Systems 2022-08-25 Cristiano Gratton , Naveen K. D. Venkategowda , Reza Arablouei , Stefan Werner

Recent approaches to distributed model fitting rely heavily on consensus ADMM, where each node solves small sub-problems using only local data. We propose iterative methods that solve {\em global} sub-problems over an entire distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-10 Tom Goldstein , Gavin Taylor , Kawika Barabin , Kent Sayre

In this work we propose a method for optimizing the lossy compression for a network of diverse reconstruction systems. We focus on adapting a standard image compression method to a set of candidate displays, presenting the decompressed…

Multimedia · Computer Science 2018-02-13 Yehuda Dar , Michael Elad , Alfred M. Bruckstein

Sparse and feature SLAM methods provide robust camera pose estimation. However, they often fail to capture the level of detail required for inspection and scene awareness tasks. Conversely, dense SLAM approaches generate richer scene…

Robotics · Computer Science 2025-05-16 Maaz Qureshi , Alexander Werner , Zhenan Liu , Amir Khajepour , George Shaker , William Melek

Stochastic gradient descent (SGD) and its many variants are the widespread optimization algorithms for training deep neural networks. However, SGD suffers from inevitable drawbacks, including vanishing gradients, lack of theoretical…

Machine Learning · Computer Science 2024-01-09 Zeinab Ebrahimi , Gustavo Batista , Mohammad Deghat
‹ Prev 1 3 4 5 6 7 10 Next ›