中文
相关论文

相关论文: Parallel Sorted Neighborhood Blocking with MapRedu…

200 篇论文

A multiple server setting is considered, where each server has tunable speed, and increasing the speed incurs an energy cost. Jobs arrive to a single queue, and each job has two types of sub-tasks, map and reduce, and a {\bf precedence}…

数据结构与算法 · 计算机科学 2021-05-20 Rahul Vaze , Jayakrishnan Nair

In this paper we describe our work on designing a web based, distributed data analysis system based on the popular MapReduce framework deployed on a small cloud; developed specifically for analyzing web server logs. The log analysis system…

分布式、并行与集群计算 · 计算机科学 2018-02-13 Galip Aydin , Ibrahim Riza Hallac

MapReduce is a commonly used framework for executing data-intensive jobs on distributed server clusters. We introduce a variant implementation of MapReduce, namely "Coded MapReduce", to substantially reduce the inter-server communication…

分布式、并行与集群计算 · 计算机科学 2015-12-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Clustering problems have numerous applications and are becoming more challenging as the size of the data increases. In this paper, we consider designing clustering algorithms that can be used in MapReduce, the most popular programming…

分布式、并行与集群计算 · 计算机科学 2011-09-09 Alina Ene , Sungjin Im , Benjamin Moseley

The Map-Reduce computing framework rose to prominence with datasets of such size that dozens of machines on a single cluster were needed for individual jobs. As datasets approach the exabyte scale, a single job may need distributed…

数据结构与算法 · 计算机科学 2016-10-31 Riley Murray , Samir Khuller , Megan Chao

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

网络与互联网体系结构 · 计算机科学 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

As the need for computational power and efficiency rises, parallel systems become increasingly popular among various scientific fields. While multiple core-based architectures have been the center of attention for many years, the rapid…

分布式、并行与集群计算 · 计算机科学 2019-06-11 E. I. Ioannidis , N. Cheimarios , A. N. Spyropoulos , A. G. Boudouvis

Level set method has been used to capture interface motion. Narrow band algorithm is applied to localize the solving of level-set PDE on global domain to a tube around interface. Due to the unknown evolving interface, narrow band algorithm…

计算物理 · 物理学 2016-12-14 Zhenlin Wang

This work explores fundamental modeling and algorithmic issues arising in the well-established MapReduce framework. First, we formally specify a computational model for MapReduce which captures the functional flavor of the paradigm by…

数据结构与算法 · 计算机科学 2013-06-13 Andrea Pietracaprina , Geppino Pucci , Matteo Riondato , Francesco Silvestri , Eli Upfal

This paper presents the design and analysis of parallel approximation algorithms for facility-location problems, including $\NC$ and $\RNC$ algorithms for (metric) facility location, $k$-center, $k$-median, and $k$-means. These problems…

数据结构与算法 · 计算机科学 2010-06-11 Guy E. Blelloch , Kanat Tangwongsan

Accurate and efficient entity resolution is an open challenge of particular relevance to intelligence organisations that collect large datasets from disparate sources with differing levels of quality and standard. Starting from a…

数据库 · 计算机科学 2018-03-20 Yuhang Zhang , Kee Siong Ng , Michael Walker , Pauline Chou , Tania Churchill , Peter Christen

We introduce an improved unsupervised clustering protocol specially suited for large-scale structured data. The protocol follows three steps: a dimensionality reduction of the data, a density estimation over the low dimensional…

机器学习 · 计算机科学 2019-11-05 Joan Garriga , Frederic Bartumeus

Graph clustering has many important applications in computing, but due to growing sizes of graphs, even traditionally fast clustering methods such as spectral partitioning can be computationally expensive for real-world graphs of interest.…

分布式、并行与集群计算 · 计算机科学 2019-06-11 Julian Shun , Farbod Roosta-Khorasani , Kimon Fountoulakis , Michael W. Mahoney

Scheduling query execution plans is a particularly complex problem in shared-nothing parallel systems, where each site consists of a collection of local time-shared (e.g., CPU(s) or disk(s)) and space-shared (e.g., memory) resources and…

数据库 · 计算机科学 2014-04-01 Minos Garofalakis , Yannis Ioannidis

With the growing complexity and capability of contemporary robotic systems, the necessity of sophisticated computing solutions to efficiently handle tasks such as real-time processing, sensor integration, decision-making, and control…

机器人学 · 计算机科学 2025-09-09 Md Rafid Islam

The generalized method to have a parallel solution to a computational problem, is to find a way to use Divide & Conquer paradigm in order to have processors acting on its own data and therefore all can be scheduled in parallel. MapReduce is…

分布式、并行与集群计算 · 计算机科学 2015-10-13 Julián Aráoz , Cristina Zoltan

Graph clustering and community detection are central problems in modern data mining. The increasing need for analyzing billion-scale data calls for faster and more scalable algorithms for these problems. There are certain trade-offs between…

社会与信息网络 · 计算机科学 2021-08-05 Jessica Shi , Laxman Dhulipala , David Eisenstat , Jakub Łącki , Vahab Mirrokni

The kernel $k$-means is an effective method for data clustering which extends the commonly-used $k$-means algorithm to work on a similarity matrix over complex data structures. The kernel $k$-means algorithm is however computationally very…

机器学习 · 计算机科学 2014-01-30 Ahmed Elgohary , Ahmed K. Farahat , Mohamed S. Kamel , Fakhri Karray

The explosion of Big Data was followed by the proliferation of numerous complex parallel software stacks whose aim is to tackle the challenges of data deluge. A drawback of a such multi-layered hierarchical deployment is the inability to…

分布式、并行与集群计算 · 计算机科学 2016-04-01 Colin Barrett , Christos Kotselidis , Mikel Luján

Among the many possible approaches for the parallelization of self-organizing networks, and in particular of growing self-organizing networks, perhaps the most common one is producing an optimized, parallel implementation of the standard…

分布式、并行与集群计算 · 计算机科学 2015-03-31 Giacomo Parigi , Angelo Stramieri , Danilo Pau , Marco Piastra