English
Related papers

Related papers: Assignment of Different-Sized Inputs in MapReduce

200 papers

This paper addresses the problem of optimizing communicated information among heterogeneous, resource-aware robot teams to facilitate their navigation. In such operations, a mobile robot compresses its local map to assist another robot in…

Robotics · Computer Science 2025-03-17 Evangelos Psomiadis , Ali Reza Pedram , Dipankar Maity , Panagiotis Tsiotras

In this paper, we study output feedback selection in linear time-invariant structured systems. We assume that the inputs and the outputs are dedicated, i.e., each input directly actuates a single state and each output directly senses a…

Optimization and Control · Mathematics 2019-04-01 Aishwary Joshi , Shana Moothedath , Prasanna Chaporkar

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

Recently, businesses have started using MapReduce as a popular computation framework for processing large amount of data, such as spam detection, and different data mining tasks, in both public and private clouds. Two of the challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-30 Nikzad Babaii Rizvandi , Javid Taheri , Reza Moraveji , Albert Y. Zomaya

A multiple server setting is considered, where each server has tunable speed, and increasing the speed incurs an energy cost. Jobs arrive to a single queue, and each job has two types of sub-tasks, map and reduce, and a {\bf precedence}…

Data Structures and Algorithms · Computer Science 2021-05-20 Rahul Vaze , Jayakrishnan Nair

In this paper, we propose an analytical method to model the dependency between configuration parameters and total execution time of Map-Reduce applications. Our approach has three key phases: profiling, modeling, and prediction. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-06 Nikzad Babaii Rizvandi , Albert Y. Zomaya , Ali Javadzadeh Boloori , Javid Taheri

In the paper, we propose a novel methodology to map learning algorithms on data (performance map) in order to gain more insights in the distribution of their performances across their parameter space. This methodology provides useful…

Machine Learning · Computer Science 2021-07-16 Filippo Neri

Collective communications, namely the patterns allgatherv, reduce_scatter, and allreduce in message-passing systems are optimised based on measurements at the installation time of the library. The algorithms used are set up in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-24 Andreas Jocksch , Noe Ohana , Emmanuel Lanti , Vasileios Karakasis , Laurent Villard

Coded distributed computing introduced by Li et al. in 2015 is an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. In particular, Li et al. show that…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Deep learning models named transformers achieved state-of-the-art results in a vast majority of NLP tasks at the cost of increased computational complexity and high memory consumption. Using the transformer model in real-time inference…

The embedding-based representation learning is commonly used in deep learning recommendation models to map the raw sparse features to dense vectors. The traditional embedding manner that assigns a uniform size to all features has two…

Machine Learning · Computer Science 2021-03-12 Siyi Liu , Chen Gao , Yihong Chen , Depeng Jin , Yong Li

There is a growing trend of performing analysis on large datasets using workflows composed of MapReduce jobs connected through producer-consumer relationships based on data. This trend has spurred the development of a number of…

Databases · Computer Science 2012-08-02 Harold Lim , Herodotos Herodotou , Shivnath Babu

In this paper, we consider the problem of recovering a graph that represents the statistical data dependency among nodes for a set of data samples generated by nodes, which provides the basic structure to perform an inference task, such as…

Machine Learning · Statistics 2018-05-01 Hyeryung Jang , HyungSeok Song , Yung Yi

We consider the problem of an auctioneer who faces the task of selling a good (drawn from a known distribution) to a set of buyers, when the auctioneer does not have the capacity to describe to the buyers the exact identity of the good that…

Computer Science and Game Theory · Computer Science 2014-01-08 Shaddin Dughmi , Nicole Immorlica , Aaron Roth

Particle filtering is a numerical Bayesian technique that has great potential for solving sequential estimation problems involving non-linear and non-Gaussian models. Since the estimation accuracy achieved by particle filters improves as…

Computation · Statistics 2017-11-22 Jeyarajan Thiyagalingam , Lykourgos Kekempanos , Simon Maskell

We propose constant approximation algorithms for generalizations of the Flexible Flow Shop (FFS) problem which form a realistic model for non-preemptive scheduling in MapReduce systems. Our results concern the minimization of the total…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-25 Dimitrios Fotakis , Ioannis Milis , Emmanouil Zampetakis , Georgios Zois

Schematic maps are in daily use to show the connectivity of subway systems and to facilitate travellers to plan their journeys effectively. This study surveys up-to-date algorithmic approaches in order to give an overview of the state of…

Physics and Society · Physics 2022-08-16 Hsiang-Yun Wu , Benjamin Niedermann , Shigeo Takahashi , Martin Nöllenburg

The emerging paradigm of distributed quantum computing promises a potential solution to scaling quantum computing to currently unfeasible dimensions. While this approach itself is still in its infancy, and many obstacles must still be…

Quantum Physics · Physics 2026-01-26 Leo Sünkel , Jonas Stein , Maximilian Zorn , Thomas Gabor , Claudia Linnhoff-Popien

This thesis investigates dataset downsampling as a strategy to optimize energy efficiency in recommender systems while maintaining competitive performance. With increasing dataset sizes posing computational and environmental challenges,…

Information Retrieval · Computer Science 2025-02-17 Ardalan Arabzadeh

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov