English
Related papers

Related papers: Content-defined Merkle Trees for Efficient Contain…

200 papers

Write-optimized dictionaries are a class of cache-efficient data structures that buffer updates and apply them in batches to optimize the amortized cache misses per update. For example, a B^epsilon tree inserts updates as messages at the…

Data Structures and Algorithms · Computer Science 2024-04-29 Christopher Chung , William Jannen , Samuel McCauley , Bertrand Simon

ML workloads are becoming increasingly popular in the cloud. Good cloud training performance is contingent on efficient parameter exchange among VMs. We find that Collectives, the widely used distributed communication algorithms, cannot…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-01 Liang Luo , Jacob Nelson , Arvind Krishnamurthy , Luis Ceze

Caching is popular technique in content delivery networks that allows for reductions in transmission rates from the content-hosting server to the end users. Coded caching is a generalization of conventional caching that considers the…

Information Theory · Computer Science 2016-07-28 Li Tang , Aditya Ramamoorthy

This paper presents an asynchronous distributed algorithm to manage multiple trees for peer-to-peer streaming in a flow level model. It is assumed that videos are cut into substreams, with or without source coding, to be distributed to all…

Data Structures and Algorithms · Computer Science 2013-08-12 Ji Zhu , Bruce Hajek

Scalability and accuracy are well recognized challenges in deep extreme multi-label learning where the objective is to train architectures for automatically annotating a data point with the most relevant subset of labels from an extremely…

Machine Learning · Computer Science 2021-11-15 Kunal Dahiya , Deepak Saini , Anshul Mittal , Ankush Shaw , Kushal Dave , Akshay Soni , Himanshu Jain , Sumeet Agarwal , Manik Varma

A crucial role of container shipping is maximizing container uptake onto vessels, optimizing the efficiency of a fundamental part of the global supply chain. In practice, liner shipping companies include block stowage patterns that ensure…

Optimization and Control · Mathematics 2024-08-16 Jaike van Twiller , Agnieszka Sivertsen , Rune M. Jensen , Kent H. Andersen

Distributed storage systems typically maintain strong consistency between data nodes and metadata nodes by adopting ordered writes: 1) first installing data; 2) then updating metadata to make data visible.We propose SwitchDelta to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Junru Li , Qing Wang , Zhe Yang , Shuo Liu , Jiwu Shu , Youyou Lu

Docker is a containerization service that allows for convenient deployment of websites, databases, applications' APIs, and machine learning (ML) models with a few lines of code. Studies have recently explored the use of Docker for deploying…

Software Engineering · Computer Science 2022-06-03 Moses Openja , Forough Majidi , Foutse Khomh , Bhagya Chembakottu , Heng Li

Dense linear layers are the dominant computational bottleneck in foundation models. Identifying more efficient alternatives to dense matrices has enormous potential for building more compute-efficient models, as exemplified by the success…

Machine Learning · Computer Science 2024-06-11 Shikai Qiu , Andres Potapczynski , Marc Finzi , Micah Goldblum , Andrew Gordon Wilson

Coded caching utilizes proper file subpacketization and coded delivery to make full use of the multicast opportunities in content delivery, to alleviate file transfer load in massive content delivery scenarios. Most existing work considers…

Information Theory · Computer Science 2021-10-01 Jialing Liao , Olav Tirkkonen

Tiered memory systems consisting of fast small memory and slow large memory have emerged to provide high capacity memory in a cost-effective way. The effectiveness of tiered memory systems relies on how many memory accesses can be absorbed…

Operating Systems · Computer Science 2025-05-15 Hyungjun Cho , Igjae Kim , Kwanghoon Choi , Hongjin Kim , Wonjae Lee , Junhyeok Im , Jinin So , Jaehyuk Huh

We propose two coded schemes for the distributed computing problem of multiplying a matrix by a set of vectors. The first scheme is based on partitioning the matrix into submatrices and applying maximum distance separable (MDS) codes to…

Information Theory · Computer Science 2018-10-22 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

This paper reveals that locking can significantly degrade the performance of applications on disaggregated memory (DM), sometimes by several orders of magnitude, due to contention on the NICs of memory nodes (MN-NICs). To address this…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-26 Hanze Zhang , Ke Cheng , Rong Chen , Xingda Wei , Haibo Chen

We consider the distributed computing problem of multiplying a set of vectors with a matrix. For this scenario, Li et al. recently presented a unified coding framework and showed a fundamental tradeoff between computational delay and…

Information Theory · Computer Science 2017-09-19 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

We present Container Data Item (CDI), an abstract datatype that allows multiple containers to efficiently operate on a common data item while preserving their strong security and isolation semantics. Application developers can use CDIs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Md Rezwanur Rahman , Tarun Annapareddy , Shirin Ebadi , Varsha Natarajan , Adarsh Srinivasan , Eric Keller , Shivakant Mishra

Eliminating duplicate data in primary storage of clouds increases the cost-efficiency of cloud service providers as well as reduces the cost of users for using cloud services. Existing primary deduplication techniques either use inline…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Huijun Wu , Chen Wang , Yinjin Fu , Sherif Sakr , Liming Zhu , Kai Lu

Erasure coding techniques are getting integrated in networked distributed storage systems as a way to provide fault-tolerance at the cost of less storage overhead than traditional replication. Redundancy is maintained over time through…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-12 Lluis Pamies-Juarez , Frédérique Oggier , Anwitaman Datta

Replicated tree data structures are extensively used in collaborative applications and distributed file systems, where clients often perform move operations. Local move operations at different replicas may be safe. However, remote move…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-22 Parwat Singh Anjana , Adithya Rajesh Chandrassery , Sathya Peri

Online 3D Bin Packing (3D-BP) with robotic arms is crucial for reducing transportation and labor costs in modern logistics. While Deep Reinforcement Learning (DRL) has shown strong performance, it often fails to adapt to real-world…

Robotics · Computer Science 2026-02-03 Jiangyi Fang , Bowen Zhou , Haotian Wang , Xin Zhu , Leye Wang