English
Related papers

Related papers: Semi-MapReduce Meets Congested Clique

200 papers

This study addresses a distributed optimization with a novel class of coupling of variables, called clique-wise coupling. A clique is a node set of a complete subgraph of an undirected graph. This setup is an extension of pairwise coupled…

Optimization and Control · Mathematics 2023-04-24 Yuto Watanabe , Kazunori Sakurama

Clustering problems have numerous applications and are becoming more challenging as the size of the data increases. In this paper, we consider designing clustering algorithms that can be used in MapReduce, the most popular programming…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-09 Alina Ene , Sungjin Im , Benjamin Moseley

We consider non-preemptive scheduling of MapReduce jobs with multiple tasks in the practical scenario where each job requires several map-reduce rounds. We seek to minimize the average weighted completion time and consider scheduling on…

Data Structures and Algorithms · Computer Science 2016-02-18 Dimitris Fotakis , Ioannis Milis , Orestis Papadigenopoulos , Vasilis Vassalos , Georgios Zois

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

In this paper, we study the MapReduce framework from an algorithmic standpoint and demonstrate the usefulness of our approach by designing and analyzing efficient MapReduce algorithms for fundamental sorting, searching, and simulation…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-11 Michael T. Goodrich , Nodari Sitchinava , Qin Zhang

Many of the classic graph problems cannot be solved in the Massively Parallel Computation setting (MPC) with strongly sublinear space per machine and $o(\log n)$ rounds, unless the 1-vs-2 cycles conjecture is false. This is true even on…

Data Structures and Algorithms · Computer Science 2022-11-22 Jacob Holm , Jakub Tětek

The congested clique model of distributed computing has been receiving attention as a model for densely connected distributed systems. While there has been significant progress on the side of upper bounds, we have very little in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-25 Janne H. Korhonen , Jukka Suomela

We present a distributed randomized algorithm finding Minimum Spanning Tree (MST) of a given graph in O(1) rounds, with high probability, in the Congested Clique model. The input graph in the Congested Clique model is a graph of n nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Tomasz Jurdzinski , Krzysztof Nowicki

Massively-parallel graph algorithms have received extensive attention over the past decade, with research focusing on three memory regimes: the superlinear regime, the near-linear regime, and the sublinear regime. The sublinear regime is…

Data Structures and Algorithms · Computer Science 2023-03-01 Orr Fischer , Adi Horowitz , Rotem Oshman

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

Information Theory · Computer Science 2022-06-28 Federico Brunero , Petros Elia

In this work, we initiate a thorough study of parameterized graph optimization problems in the distributed setting. In a parameterized problem, an algorithm decides whether a solution of size bounded by a \emph{parameter} $k$ exists and if…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-07 Ran Ben-Basat , Ken-ichi Kawarabayashi , Gregory Schwartzman

The study of approximate matching in the Massively Parallel Computations (MPC) model has recently seen a burst of breakthroughs. Despite this progress, however, we still have a far more limited understanding of maximal matching which is one…

Data Structures and Algorithms · Computer Science 2023-10-17 Soheil Behnezhad , MohammadTaghi Hajiaghayi , David G. Harris

Semidefinite programming (SDP) is widely acknowledged as one of the most effective methods for deriving the tightest lower bounds of the optimal power flow (OPF) problems. In this paper, an enhanced semidefinite relaxation model that…

Systems and Control · Electrical Eng. & Systems 2024-10-01 Zhaojun Ruan , Libao Shi

A fundamental question that shrouds the emergence of massively parallel computing (MPC) platforms is how can the additional power of the MPC paradigm be leveraged to achieve faster algorithms compared to classical parallel models such as…

Data Structures and Algorithms · Computer Science 2018-05-09 Sepehr Assadi , Xiaorui Sun , Omri Weinstein

Graph partitioning schedules parallel calculations like sparse matrix-vector multiply (SpMV). We consider contiguous partitions, where the $m$ rows (or columns) of a sparse matrix with $N$ nonzeros are split into $K$ parts without…

Data Structures and Algorithms · Computer Science 2024-10-30 Willow Ahrens

In this work, we use algebraic methods for studying distance computation and subgraph detection tasks in the congested clique model. Specifically, we adapt parallel matrix multiplication implementations to the congested clique, obtaining an…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-24 Keren Censor-Hillel , Petteri Kaski , Janne H. Korhonen , Christoph Lenzen , Ami Paz , Jukka Suomela

In this paper we propose a parallel coordinate descent algorithm for solving smooth convex optimization problems with separable constraints that may arise e.g. in distributed model predictive control (MPC) for linear network systems. Our…

Optimization and Control · Mathematics 2014-11-19 Ion Necoara , Dragos Clipici

We present shared-memory parallel methods for Maximal Clique Enumeration (MCE) from a graph. MCE is a fundamental and well-studied graph analytics task, and is a widely used primitive for identifying dense structures in a graph. Due to its…

Data Structures and Algorithms · Computer Science 2020-01-30 Apurba Das , Seyed-Vahid Sanei-Mehri , Srikanta Tirthapura

A wide variety of problems in machine learning, including exemplar clustering, document summarization, and sensor placement, can be cast as constrained submodular maximization problems. A lot of recent effort has been devoted to developing…

Data Structures and Algorithms · Computer Science 2016-08-15 Rafael da Ponte Barbosa , Alina Ene , Huy L. Nguyen , Justin Ward

In this paper we give fast distributed graph algorithms for detecting and listing small subgraphs, and for computing or approximating the girth. Our algorithms improve upon the state of the art by polynomial factors, and for girth, we…

Data Structures and Algorithms · Computer Science 2021-01-20 Keren Censor-Hillel , Orr Fischer , Tzlil Gonen , François Le Gall , Dean Leitersdorf , Rotem Oshman