中文
相关论文

相关论文: Efficient Support of Big Data Storage Systems on t…

200 篇论文

Distributed data processing platforms (e.g., Hadoop, Spark, and Flink) are widely used to distribute the storage and processing of data among computing nodes of a cloud. The centralization of cloud resources has given birth to edge…

分布式、并行与集群计算 · 计算机科学 2022-01-07 Faheem Ullah , Imaduddin Mohammed , M. Ali Babar

Data distribution across different facilities offers benefits such as enhanced resource utilization, increased resilience through replication, and improved performance by processing data near its source. However, managing such data is…

Distributed storage systems such as Hadoop File System or Google File System (GFS) ensure data availability and durability using replication. This paper is focused on the analysis of the efficiency of replication mechanism that determines…

分布式、并行与集群计算 · 计算机科学 2017-03-28 Wen Sun , Véronique Simon , Sébastien Monnet , Philippe Robert , Pierre Sens

Distributed Hash Tables offer a resilient lookup service for unstable distributed environments. Resilient data storage, however, requires additional data replication and maintenance algorithms. These algorithms can have an impact on both…

分布式、并行与集群计算 · 计算机科学 2007-05-23 Matthew Leslie

One of the purposes of Big Data systems is to support analysis of data gathered from heterogeneous data sources. Since data warehouses have been used for several decades to achieve the same goal, they could be leveraged also to provide…

数据库 · 计算机科学 2018-09-13 Darja Solodovnikova , Laila Niedrite

Distributed data processing platforms for cloud computing are important tools for large-scale data analytics. Apache Hadoop MapReduce has become the de facto standard in this space, though its programming interface is relatively low-level,…

分布式、并行与集群计算 · 计算机科学 2018-03-30 Bilal Akil , Ying Zhou , Uwe Röhm

Cloud computing is a cost-effective way for start-up life sciences laboratories to store and manage their data. However, in many instances the data stored over the cloud could be redundant which makes cloud-based data management inefficient…

分布式、并行与集群计算 · 计算机科学 2017-03-30 Kashish Ara Shakil , Ari Ora , Mansaf Alam , Shabih Shakeel

HPC environments have traditionally been designed to meet the compute demand of scientific applications and data has only been a second order concern. With science moving toward data-driven discoveries relying more on correlations in data…

分布式、并行与集群计算 · 计算机科学 2015-01-22 Andre Luckow , Pradeep Mantha , Shantenu Jha

This is a survey of some of the currently available frameworks (opensource/commercial) in order to run distributed data applications(Hadoop, Spark) on secure enclaves. Intel, AMD, Amazon support secure enclaves on their systems Intel-SGX,…

分布式、并行与集群计算 · 计算机科学 2020-05-18 Srinivasa Rao Aravilli

Public cloud computing environments, such as Amazon AWS, Microsoft Azure, and the Google Cloud Platform, have achieved remarkable improvements in computational performance in recent years, and are also expected to be able to perform…

分布式、并行与集群计算 · 计算机科学 2020-06-17 Masahito Ohue , Kento Aoyama , Yutaka Akiyama

Cloud Computing means a place where we can store our valuable information of data and access the computing and networking services following the pay-as-you-go method without a physical environment. In the present day, cloud computing offers…

网络与互联网体系结构 · 计算机科学 2024-09-02 Rehnuma Tasnim , Afrin Akter Mim , Salman Hasan Mim , Md. Ismail Jabiullah

Microservice architecture has transformed the way developers are building and deploying applications in the nowadays cloud computing centers. This new approach provides increased scalability, flexibility, manageability, and performance…

分布式、并行与集群计算 · 计算机科学 2020-10-06 Hamzeh Khazaei , Nima Mahmoudi , Cornel Barna , Marin Litoiu

Energy systems generate vast amounts of data in extremely short time intervals, creating challenges for efficient data management. Traditional data management methods often struggle with scalability and accessibility, limiting their…

数据库 · 计算机科学 2025-07-28 Lunodzo J. Mwinuka , Massimo Cafaro , Lucas Pereira , Hugo Morais

Cloud computing provides ubiquitous and on-demand access to vast reconfigurable resources that can meet any computational need. Many service models are available, but the Infrastructure as a Service (IaaS) model is particularly suited to…

分布式、并行与集群计算 · 计算机科学 2020-09-29 Gianluca Longoni , Ryan LaMothe , Jeremy Teuton , Mark Greaves , Nicole Nichols , William Smith

The proliferation of sensor technologies and advancements in data collection methods have enabled the accumulation of very large amounts of data. Increasingly, these datasets are considered for scientific research. However, the design of…

分布式、并行与集群计算 · 计算机科学 2020-07-28 Fatemeh Rouzbeh , Ananth Grama , Paul Griffin , Mohammad Adibuzzaman

We consider how underused computing resources within an enterprise may be harnessed to improve utilization and create an elastic computing infrastructure. Most current cloud provision involves a data center model, in which clusters of…

分布式、并行与集群计算 · 计算机科学 2016-09-08 Graham Kirby , Alan Dearle , Angus Macdonald , Alvaro Fernandes

Data-intensive platforms such as Hadoop and Spark are routinely used to process massive amounts of data residing on distributed file systems like HDFS. Increasing memory sizes and new hardware technologies (e.g., NVRAM, SSDs) have recently…

分布式、并行与集群计算 · 计算机科学 2020-06-22 Herodotos Herodotou , Elena Kakoulli

The workloads running in the modern data centers of large scale Internet service providers (such as Amazon, Baidu, Facebook, Google, and Microsoft) support billions of users and span globally distributed infrastructure. Yet, the devices…

分布式、并行与集群计算 · 计算机科学 2019-01-14 Justin Meza

Erasure codes have been widely considered a promising solution to enhance data reliability at low storage costs. However, in modern geo-distributed storage systems, erasure codes may incur high data access latency as they require data…

信息论 · 计算机科学 2020-12-08 Kaiyang Liu , Jun Peng , Jingrong Wang , Jianping Pan

Big data dictate their requirements to the hardware and software. Simple migration to the cloud data processing, while solving the problem of increasing computational capabilities, however creates some issues: the need to ensure the safety,…

分布式、并行与集群计算 · 计算机科学 2015-07-03 E. Nikulchev , E. Pluzhnik , D. Biryukov , O. Lukyanchikov , S. Payain