English
Related papers

Related papers: PAT: a new algorithm for all-gather and reduce-sca…

200 papers

In terms of signal samples, we propose and justify a new rank reduced multi-term transform, abbreviated as MTT, which, under certain conditions, may provide better-associated accuracy than that of known optimal rank reduced transforms. The…

Optimization and Control · Mathematics 2021-11-11 Pablo Soto-Quiros , Anatoli Torokhti

We propose a new anytime hierarchical clustering method that iteratively transforms an arbitrary initial hierarchy on the configuration of measurements along a sequence of trees we prove for a fixed data set must terminate in a chain of…

Machine Learning · Statistics 2014-04-15 Omur Arslan , Daniel E. Koditschek

We present a fast multiscale approach for the network minimum logarithmic arrangement problem. This type of arrangement plays an important role in a network compression and fast node/link access operations. The algorithm is of linear…

Data Structures and Algorithms · Computer Science 2010-04-30 Ilya Safro , Boris Temkin

In this paper, we present a fully-dynamic distributed algorithm for maintaining a minimum spanning tree on general graphs with positive real edge weights. The goal of a dynamic MST algorithm is to update efficiently the minimum spanning…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Pradosh Kumar Mohapatra

A fundamental challenge in large-scale networked systems viz., data centers and cloud networks is to distribute tasks to a pool of servers, using minimal instantaneous state information, while providing excellent delay performance. In this…

Probability · Mathematics 2018-09-07 Debankur Mukherjee

We propose a new regression algorithm that learns from a set of input-output pairs. Our algorithm is designed for populations where the relation between the input variables and the output variable exhibits a heterogeneous behavior across…

Machine Learning · Computer Science 2026-02-17 Ş. İlker Birbil , Sinan Yıldırım , Samet Çopur , M. Hakan Akyüz

The demand for large-scale deep learning is increasing, and distributed training is the current mainstream solution. Ring AllReduce is widely used as a data parallel decentralized algorithm. However, in a heterogeneous environment, each…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Yongyue Chao , Mingxue Liao , Jiaxin Gao

In this paper, we study the $r$-gather problem, a natural formulation of minimum-size clustering in metric spaces. The goal of $r$-gather is to partition $n$ points into clusters such that each cluster has size at least $r$, and the maximum…

Data Structures and Algorithms · Computer Science 2021-06-08 Alessandro Epasto , Mohammad Mahdian , Vahab Mirrokni , Peilin Zhong

In Multi-Agent Reinforcement Learning (MARL), multiple agents interact with a common environment, as also with each other, for solving a shared problem in sequential decision-making. It has wide-ranging applications in gaming, robotics,…

Machine Learning · Computer Science 2022-01-19 Gugan Thoppe , Bhumesh Kumar

Processing large complex networks like social networks or web graphs has recently attracted considerable interest. In order to do this in parallel, we need to partition them into pieces of about equal size. Unfortunately, previous parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-27 Henning Meyerhenke , Peter Sanders , Christian Schulz

The sheer sizes of modern datasets are forcing data-structure designers to consider seriously both parallel construction and compactness. To achieve those goals we need to design a parallel algorithm with good scalability and with low…

Data Structures and Algorithms · Computer Science 2017-05-02 Leo Ferres , José Fuentes-Sepúlveda , Travis Gagie , Meng He , Gonzalo Navarro

Random walks are a fundamental primitive used in many machine learning algorithms with several applications in clustering and semi-supervised learning. Despite their relevance, the first efficient parallel algorithm to compute random walks…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-02 Michael Kapralov , Silvio Lattanzi , Navid Nouri , Jakab Tardos

We propose a general transfer learning framework for clustering given a main dataset and an auxiliary one about the same subjects. The two datasets may reflect similar but different latent grouping structures of the subjects. We propose an…

Methodology · Statistics 2026-03-10 Yuqi Gu , Zhongyuan Lyu , Kaizheng Wang

Many big data algorithms executed on MapReduce-like systems have a shuffle phase that often dominates the overall job execution time. Recent work has demonstrated schemes where the communication load in the shuffle phase can be traded off…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-02 Konstantinos Konstantinidis , Aditya Ramamoorthy

Finding the number of triangles in a network is an important problem in the analysis of complex networks. The number of triangles also has important applications in data mining. Existing distributed memory parallel algorithms for counting…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-24 Shaikh Arifuzzaman , Maleq Khan , Madhav Marathe

In this paper we present two versions of a parallel working-set map on p processors that supports searches, insertions and deletions. In both versions, the total work of all operations when the map has size at least p is bounded by the…

Data Structures and Algorithms · Computer Science 2018-07-12 Kunal Agrawal , Seth Gilbert , Wei Quan Lim

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

How can non-communicating agents learn to share congested resources efficiently? This is a challenging task when the agents can access the same resource simultaneously (in contrast to multi-agent multi-armed bandit problems) and the…

Multiagent Systems · Computer Science 2021-05-13 Tomer Boyarski , Amir Leshem , Vikram Krishnamurthy

In this work, a heterogeneous set of wireless devices sharing a common access point collaborates to perform a set of tasks. Using the Map-Reduce distributed computing framework, the tasks are optimally distributed amongst the nodes with the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Antoine Paris , Hamed Mirghasemi , Ivan Stupia , Luc Vandendorpe

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi