English
Related papers

Related papers: Majorization Minimization Methods for Distributed …

200 papers

Convex optimization is an essential tool for modern data analysis, as it provides a framework to formulate and solve many problems in machine learning and data mining. However, general convex optimization solvers do not scale well, and…

Social and Information Networks · Computer Science 2015-07-02 David Hallac , Jure Leskovec , Stephen Boyd

Localization in a pre-built map is a basic technique for robot autonomous navigation. Existing mapping and localization methods commonly work well in small-scale environments. As a map grows larger, however, more memory is required and…

Robotics · Computer Science 2023-03-21 Xiaoyu Zhang , Yun-Hui Liu

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

In this paper we consider a distributed optimization scenario in which a set of processors aims at cooperatively solving a class of min-max optimization problems. This set-up is motivated by peak-demand minimization problems in smart grids.…

Optimization and Control · Mathematics 2016-11-29 Ivano Notarnicola , Mauro Franceschelli , Giuseppe Notarstefano

Optimizing large-scale nonconvex problems, common in deep learning, demands balancing rapid convergence with computational efficiency. First-order (FO) optimizers, which serve as today's baselines, provide fast convergence and good…

Machine Learning · Computer Science 2025-09-30 Jiahe Chen , Ziye Ma

The Minimum Dominating Set (MDS) problem is one of the most fundamental and challenging problems in distributed computing. While it is well-known that minimum dominating sets cannot be approximated locally on general graphs, over the last…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-18 Saeed Akhoondian Amiri , Stefan Schmid , Sebastian Siebertz

Consider $n$ agents connected over a network collaborating to minimize the average of their local cost functions combined with a common nonsmooth function. This paper introduces a unified algorithmic framework for solving such a problem…

Optimization and Control · Mathematics 2026-05-05 Kun Huang , Shi Pu , Angelia Nedić

We consider distributed optimization in random networks where N nodes cooperatively minimize the sum \sum_{i=1}^N f_i(x) of their individual convex costs. Existing literature proposes distributed gradient-like methods that are…

Information Theory · Computer Science 2023-07-19 Dusan Jakovetic , Joao Xavier , Jose M. F. Moura

Millimeter wave (mmWave) cell-free massive MIMO (CF mMIMO) is a promising solution for future wireless communications. However, its optimization is non-trivial due to the challenging channel characteristics. We show that mmWave CF mMIMO…

Signal Processing · Electrical Eng. & Systems 2024-06-11 Bile Peng , Bihan Guo , Karl-Ludwig Besser , Luca Kunz , Ramprasad Raghunath , Anke Schmeink , Eduard A Jorswieck , Giuseppe Caire , H. Vincent Poor

Graph embedding learns low-dimensional representations for nodes in a graph and effectively preserves the graph structure. Recently, a significant amount of progress has been made toward this emerging research area. However, there are…

Machine Learning · Computer Science 2019-05-20 Yuan Yin , Zhewei Wei

Convolved Gaussian Process (CGP) is able to capture the correlations not only between inputs and outputs but also among the outputs. This allows a superior performance of using CGP than standard Gaussian Process (GP) in the modelling of…

Neural and Evolutionary Computing · Computer Science 2017-09-14 Gang Cao , Edmund M-K Lai , Fakhrul Alam

Graph clustering is an important unsupervised learning technique for partitioning graphs with attributes and detecting communities. However, current methods struggle to accurately capture true community structures and intra-cluster…

Machine Learning · Computer Science 2024-11-19 Samarth Bhatia , Yukti Makhija , Manoj Kumar , Sandeep Kumar

Non-convex optimization is ubiquitous in machine learning. Majorization-Minimization (MM) is a powerful iterative procedure for optimizing non-convex functions that works by optimizing a sequence of bounds on the function. In MM, the bound…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Sobhan Naderi Parizi , Kun He , Reza Aghajani , Stan Sclaroff , Pedro Felzenszwalb

In modern large-scale networked systems, rapidly solving optimization problems while utilizing communication resources efficiently is critical for addressing complex tasks. In this paper, we consider an unconstrained distributed…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Ruochen Wu , Xu Du , Karl H. Johansson , Apostolos I. Rikos

Composite convex optimization models arise in several applications, and are especially prevalent in inverse problems with a sparsity inducing norm and in general convex optimization with simple constraints. The most widely used algorithms…

Optimization and Control · Mathematics 2016-07-15 Vahan Hovhannisyan , Panos Parpas , Stefanos Zafeiriou

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

Machine Learning · Computer Science 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the…

Data Structures and Algorithms · Computer Science 2019-02-19 Dmitrii Avdiukhin , Sergey Pupyrev , Grigory Yaroslavtsev

Block majorization-minimization (BMM) is a simple iterative algorithm for constrained nonconvex optimization that sequentially minimizes majorizing surrogates of the objective function in each block while the others are held fixed. BMM…

Optimization and Control · Mathematics 2025-01-22 Hanbaek Lyu , Yuchen Li

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

The mobile robot dispersion problem on graphs asks $k\leq n$ robots placed initially arbitrarily on the nodes of an $n$-node anonymous graph to reposition autonomously to reach a configuration in which each robot is on a distinct node of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-30 Ajay D. Kshemkalyani , Anisur Rahaman Molla , Gokarna Sharma