English
Related papers

Related papers: Technical Report: Estimating Reliability of Worker…

200 papers

The constant increase in parallelism available on large-scale distributed computers poses major scalability challenges to many scientific applications. A common strategy to improve scalability is to express the algorithm in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Andrew Garmon , Vinay Ramakrishnaiah , Danny Perez

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

Distributed consensus has been widely studied for sensor network applications. Whereas the asymptotic convergence rate has been extensively explored in prior work, other important and practical issues, including energy efficiency and link…

Networking and Internet Architecture · Computer Science 2013-04-10 Lei Chen , Jeff Frolik

The increasing interest in serverless computation and ubiquitous wireless networks has led to numerous connected devices in our surroundings. Among such devices, IoT devices have access to an abundance of raw data, but their inadequate…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-12 Ramyad Hadidi , Jiashen Cao , Hyesoon Kim

We study the problem of scheduling jobs on fault-prone machines communicating via a shared channel, also known as multiple-access channel. We have $n$ arbitrary length jobs to be scheduled on $m$ identical machines, $f$ of which are prone…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Marek Klonowski , Dariusz R. Kowalski , Jarosław Mirek , Prudence W. H. Wong

To get estimators that work within a certain error bound with high probability, a common strategy is to design one that works with constant probability, and then boost the probability using independent repetitions. Important examples of…

Data Structures and Algorithms · Computer Science 2020-04-03 Anders Aamand , Debarati Das , Evangelos Kipouridis , Jakob B. T. Knudsen , Peter M. R. Rasmussen , Mikkel Thorup

High fidelity simulation of large-sized complex networks can be realized on a distributed computing platform that leverages the combined resources of multiple processors or machines. In a discrete event driven simulation, the assignment of…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-16 Aditya Kurve , Christopher Griffin , David J. Miller , George Kesidis

Distributed processing over networks relies on in-network processing and cooperation among neighboring agents. Cooperation is beneficial when agents share a common objective. However, in many applications agents may belong to different…

Optimization and Control · Mathematics 2023-07-19 Xiaochuan Zhao , Ali H. Sayed

Motivated by decentralized sensing and policy evaluation problems, we consider a particular type of distributed stochastic optimization problem over a network, called the online stochastic distributed averaging problem. We design a…

Optimization and Control · Mathematics 2022-08-10 Sheng Zhang , Ashwin Pananjady , Justin Romberg

In this era of large-scale data, distributed systems built on top of clusters of commodity hardware provide cheap and reliable storage and scalable processing of massive data. Here, we review recent work on developing and implementing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

Scheduling is an important task allowing parallel systems to perform efficiently and reliably. For modern computation systems, divisible load is a special type of data which can be divided into arbitrary sizes and independently processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-07 Fei Wu , Yang Cao , Thomas Robertazzi

Data replication is used in distributed systems to maintain up-to-date copies of shared data across multiple computers in a network. However, despite decades of research, algorithms for achieving consistency in replicated systems are still…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-30 Victor B. F. Gomes , Martin Kleppmann , Dominic P. Mulligan , Alastair R. Beresford

We introduce a method for sparsifying distributed algorithms and exhibit how it leads to improvements that go past known barriers in two algorithmic settings of large-scale graph processing: Massively Parallel Computation (MPC), and Local…

Data Structures and Algorithms · Computer Science 2018-07-18 Mohsen Ghaffari , Jara Uitto

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

We consider algorithmic problems in the setting in which the input data has been partitioned arbitrarily on many servers. The goal is to compute a function of all the data, and the bottleneck is the communication used by the algorithm. We…

Data Structures and Algorithms · Computer Science 2014-07-01 Ravindran Kannan , Santosh Vempala , David Woodruff

In this paper we propose and analyze a distributed algorithm for achieving globally optimal decisions, either estimation or detection, through a self-synchronization mechanism among linearly coupled integrators initialized with local…

Multiagent Systems · Computer Science 2009-11-13 Gesualdo Scutari , Sergio Barbarossa , Loreto Pescosolido

The emerging large-scale and data-hungry algorithms require the computations to be delegated from a central server to several worker nodes. One major challenge in the distributed computations is to tackle delays and failures caused by the…

Information Theory · Computer Science 2021-03-03 Alejandro Cohen , Guillaume Thiran , Homa Esfahanizadeh , Muriel Médard

Robustness of a distributed computing system is defined as the ability to maintain its performance in the presence of uncertain parameters. Uncertainty is a key problem in heterogeneous (and even homogeneous) distributed computing systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-25 Ali Mokhtari , Chavit Denninnart , Mohsen Amini Salehi

We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as…

Information Theory · Computer Science 2012-04-18 Mihai-Alin Badiu , Carles Navarro Manchón , Vasile Bota , Bernard Henri Fleury

In the current work we introduce a novel estimation of distribution algorithm to tackle a hard combinatorial optimization problem, namely the single-machine scheduling problem, with uncertain delivery times. The majority of the existing…

Data Structures and Algorithms · Computer Science 2013-12-05 Boris Mitavskiy , Jun He