English
Related papers

Related papers: Addressing NameNode Scalability Issue in Hadoop Di…

200 papers

With the sharp growth of cloud services and their possible combinations, the scale of data center network traffic has an inevitable explosive increasing in recent years. Software defined network (SDN) provides a scalable and flexible…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-13 He Li , Song Guo , Chentao Wu , Jie Li

The MultiNoC system implements a programmable on-chip multiprocessing platform built on top of an efficient, low area overhead intra-chip interconnection scheme. The employed interconnection structure is a Network on Chip, or NoC. NoCs are…

Hardware Architecture · Computer Science 2011-11-09 Aline Mello , Leandro Moller , Ney Calazans , Fernando Moraes

This paper focuses on data structures for multi-core reachability, which is a key component in model checking algorithms and other verification methods. A cornerstone of an efficient solution is the storage of visited states. In related…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-06 Alfons Laarman , Jaco van de Pol , Michael Weber

Decentralized coded caching is studied for a content server with $N$ files, each of size $F$ bits, serving $K$ active users, each equipped with a cache of distinct capacity. It is assumed that the users' caches are filled in advance during…

Information Theory · Computer Science 2016-10-13 Mohammad Mohammadi Amiri , Qianqian Yang , Deniz Gündüz

Clustering analysis is of substantial significance for data mining. The properties of big data raise higher demand for more efficient and economical distributed clustering methods. However, existing distributed clustering methods mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-03 Yifeng Xiao , Jiang Xue , Deyu Meng

The number of mobile devices (e.g., smartphones, wearable technologies) is rapidly growing. In line with this trend, a massive amount of spatial data is being collected since these devices allow users to geo-tag user-generated content.…

Databases · Computer Science 2016-12-20 Afsin Akdogan

The increasing adoption of Cloud-based data processing and storage poses a number of privacy issues. Users wish to preserve full control over their sensitive data and cannot accept it to be fully accessible to an external storage provider.…

Cryptography and Security · Computer Science 2015-03-30 Francesco Pagano

The distributed edge storage system can store data collected at the edge of the network in a decentralised manner, with low latency, high security, and flexibility. Traditional edge-distributed storage systems only consider one single…

Networking and Internet Architecture · Computer Science 2023-10-10 Yejin Yang , Miao Ye , Qiuxiang Jiang , Peng Wen

We consider the data shuffling problem in a distributed learning system, in which a master node is connected to a set of worker nodes, via a shared link, in order to communicate a set of files to the worker nodes. The master node has access…

Information Theory · Computer Science 2020-06-24 Adel Elmahdy , Soheil Mohajer

Distributed denial of service attacks are often considered a security problem. While this may be the way to view the problem with today's Internet, new network architectures attempting to address the issue should view it as a scalability…

Networking and Internet Architecture · Computer Science 2012-01-26 Yoo Chung

Web application performance is heavily reliant on the hit rate of memory-based caches. Current DRAM-based web caches statically partition their memory across multiple applications sharing the cache. This causes under utilization of memory…

Operating Systems · Computer Science 2016-10-27 Asaf Cidon , Daniel Rushton , Stephen M. Rumble , Ryan Stutsman

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

Transitioning cloud-based Hadoop from IaaS to PaaS, which are commercially conceptualized as pay-as-you-go or pay-per-use, often reduces the associated system costs. However, managed Hadoop systems do present a black-box behavior to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Uluer Emre Ozdil , Serkan Ayvaz

This paper considers a hierarchical caching system where a server connects with multiple mirror sites, each connecting with a distinct set of users, and both the mirror sites and users are equipped with caching memories. Although there…

Information Theory · Computer Science 2022-09-27 Yun Kong , Youlong Wu , Minquan Cheng

A key challenge in on-chip interconnect design is to scale up bandwidth while maintaining low latency and high area efficiency. 2D-meshes scale with low wiring area and congestion overhead; however, their end-to-end latency increases with…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Yichao Zhang , Zexin Fu , Tim Fischer , Yinrong Li , Marco Bertuletti , Luca Benini

Big data storage management is one of the most challenging issues for Grid computing environments, since large amount of data intensive applications frequently involve a high degree of data access locality. Grid applications typically deal…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-13 Ajay Kumar , Seema Bawa

In cache-aided networks, the server populates the cache memories at the users during low-traffic periods, in order to reduce the delivery load during peak-traffic hours. In turn, there exists a fundamental trade-off between the delivery…

Information Theory · Computer Science 2019-03-15 Abdelrahman M. Ibrahim , Ahmed A. Zewail , Aylin Yener

HPC-based applications often have complex workflows with many software dependencies that hinder their portability on contemporary HPC architectures. In addition, these applications often require extraordinary efforts to deploy and execute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-14 Sameh Abdulah , Jorge Ejarque , Omar Marzouk , Hatem Ltaief , Ying Sun , Marc G. Genton , Rosa M. Badia , David E. Keyes

Content delivery networks store information distributed across multiple servers, so as to balance the load and avoid unrecoverable losses in case of node or disk failures. Coded caching has been shown to be a useful technique which can…

Information Theory · Computer Science 2016-11-22 Tianqiong Luo , Vaneet Aggarwal , Borja Peleato

dCache (https://dcache.org) is a highly scalable storage system providing location-independent access to data. The data are stored across multiple data servers as complete files presented to the end-user via a single-rooted namespace. From…