English
Related papers

Related papers: Reducing Data Fragmentation in Data Deduplication …

200 papers

In this paper we tackle the fragmentation problem for highly distributed databases. In such an environment, a suitable fragmentation strategy may provide scalability and availability by minimizing distributed transactions. We propose an…

Databases · Computer Science 2013-04-25 Rebeca Schroeder , Ronaldo Santos Mello , Carmem Satie Hara

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

In cloud storage systems with a large number of servers, files are typically not stored in single servers. Instead, they are split, replicated (to ensure reliability in case of server malfunction) and stored in different servers. We analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-09 Avishek Ghosh , Kannan Ramchandran

Distributed storage systems that deploy erasure codes can provide better features such as lower storage overhead and higher data reliability. In this paper, we focus on fractional repetition (FR) codes, which are a class of storage codes…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Kenneth W. Shum , Hui Li

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

Data Structures and Algorithms · Computer Science 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

We study a generalization of deduplication, which enables lossless deduplication of highly similar data and show that standard deduplication with fixed chunk length is a special case. We provide bounds on the expected length of coded…

Information Theory · Computer Science 2020-03-04 Rasmus Vestergaard , Qi Zhang , Daniel E. Lucani

In the presence of dynamic insertions and deletions into a partially reconfigurable FPGA, fragmentation is unavoidable. This poses the challenge of developing efficient approaches to dynamic defragmentation and reallocation. One key aspect…

Data Structures and Algorithms · Computer Science 2017-02-27 Sándor P. Fekete , Jan-Marc Reinhardt , Christian Scheffer

Core decomposition is a fundamental graph problem with a large number of applications. Most existing approaches for core decomposition assume that the graph is kept in memory of a machine. Nevertheless, many real-world graphs are big and…

Databases · Computer Science 2015-11-03 Dong Wen , Lu Qin , Ying Zhang , Xuemin Lin , Jeffrey Xu Yu

Currently, an increasing number of users and enterprises are storing their data in the cloud but do not fully trust cloud providers with their data in plaintext form. To address this concern, they encrypt their data before uploading it to…

Cryptography and Security · Computer Science 2025-01-07 Zhaokang Ke , Haoyu Gong , David H. C. Du

K-core decomposition is a commonly used metric to analyze graph structure or study the relative importance of nodes in complex graphs. Recent years have seen rapid growth in the scale of the graph, especially in industrial settings. For…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-03 Shicheng Gao , Jie Xu , Xiaosen Li , Fangcheng Fu , Wentao Zhang , Wen Ouyang , Yangyu Tao , Bin Cui

Analyzing interconnection structures among underlying entities or objects in a dataset through the use of graph analytics has been shown to provide tremendous value in many application domains. However, graphs are not the primary…

Databases · Computer Science 2017-02-14 Konstantinos Xirogiannopoulos , Amol Deshpande

Distributed storage systems with replication are well known for storing large amount of data. A large number of replication is done in order to provide reliability. This makes the system expensive. Various methods have been proposed over…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-01 Mit Sheth , Krishna Gopal Benerjee , Manish K. Gupta

Data deduplication has gained wide acclaim as a mechanism to improve storage efficiency and conserve network bandwidth. Its most critical phase, data chunking, is responsible for the overall space savings achieved via the deduplication…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Sreeharsha Udayashankar , Samer Al-Kiswany

We study online graph queries that retrieve nearby nodes of a query node from a large network. To answer such queries with high throughput and low latency, we partition the graph and process the data in parallel across a cluster of servers.…

Databases · Computer Science 2017-10-17 Arijit Khan , Gustavo Segovia , Donald Kossmann

Given a large graph, a graph sample determines a subgraph with similar characteristics for certain metrics of the original graph. The samples are much smaller thereby accelerating and simplifying the analysis and visualization of large…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-11 Kevin Gomez , Matthias Täschner , M. Ali Rostami , Christopher Rost , Erhard Rahm

External fragmentation of physical memory occurs when adjacent differently sized regions of allocated physical memory are freed at different times, causing free memory to be physically discontiguous. It can significantly degrade system…

Operating Systems · Computer Science 2024-01-09 Mark Mansi , Michael M. Swift

This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously…

Machine Learning · Statistics 2019-01-04 Raj Kumar Maity , Ankit Singh Rawat , Arya Mazumdar

Micro-segmentation is an emerging security technique that separates physical networks into isolated logical micro-segments (workloads). By tying fine-grained security policies to individual workloads, it limits the attacker's ability to…

Networking and Internet Architecture · Computer Science 2023-06-01 Nardine Basta , Muhammad Ikram , Mohamed Ali Kaafar , Andy Walker

Over the past decade, we witness an increasing amount of interest in the design of exact exponential-time and parameterized algorithms for problems in Graph Drawing. Unfortunately, we still lack knowledge of general methods to develop such…

Data Structures and Algorithms · Computer Science 2023-10-10 Siddharth Gupta , Guy Sa'ar , Meirav Zehavi

To improve the temporal and spatial storage efficiency, researchers have intensively studied various techniques, including compression and deduplication. Through our evaluation, we find that methods such as photo tags or local features help…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-20 Binqi Zhang , Chen Wang , Bing Bing Zhou , Albert Y. Zomaya