English
Related papers

Related papers: An Overview of Video Allocation Algorithms for Fla…

200 papers

In this paper we analyze the influence that lower layers (file system, OS, SSD) have on HDFS' ability to extract maximum performance from SSDs on the read path. We uncover and analyze three surprising performance slowdowns induced by lower…

Operating Systems · Computer Science 2019-03-25 María F. Borge , Florin Dinu , Willy Zwaenepoel

Neural personalized recommendation models are used across a wide variety of datacenter applications including search, social media, and entertainment. State-of-the-art models comprise large embedding tables that have billions of parameters…

Hardware Architecture · Computer Science 2021-02-02 Mark Wilkening , Udit Gupta , Samuel Hsia , Caroline Trippel , Carole-Jean Wu , David Brooks , Gu-Yeon Wei

We consider the problem of online allocation (matching and assortments) of reusable resources where customers arrive sequentially in an adversarial fashion and allocated resources are used or rented for a stochastic duration that is drawn…

Data Structures and Algorithms · Computer Science 2022-07-20 Vineet Goyal , Garud Iyengar , Rajan Udwani

Emerging storage systems with new flash exhibit ultra-low latency (ULL) that can address performance disparities between DRAM and conventional solid state drives (SSDs) in the memory hierarchy. Considering the advanced low-latency…

Operating Systems · Computer Science 2019-12-17 Sungjoon Koh , Junhyeok Jang , Changrim Lee , Miryeong Kwon , Jie Zhang , Myoungsoo Jung

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

Hybrid Solid-State Drives (SSDs), which integrate several types of flash cells (e.g., single-level cell (SLC) and multiple-level cell (MLC)) in a single drive and enable them to convert between each other, are designed to deliver both high…

Hardware Architecture · Computer Science 2025-03-18 Qian Wei , Yi Li , Zehao Chen , Zhaoyan Shen , Dongxiao Yu , Bingzhe Li

During the last decade or so, we have had a deluge of data from not only science fields but also industry and commerce fields. Although the amount of data available to us is constantly increasing, our ability to process it becomes more and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-13 Nhien-An Le-Khac , Lamine Aouad , M-Tahar Kechadi

Access to sensing data (SD) is crucial for vehicular networks to ensure safe and efficient transportation services. Given the vast volume of data involved, proactive caching required SD is a pivotal strategy for alleviating network…

Networking and Internet Architecture · Computer Science 2025-02-19 Yantong Wang , Ke Liu , Hui Ji , Jiande Sun

Management of disk scheduling is a very important aspect of operating system. Performance of the disk scheduling completely depends on how efficient is the scheduling algorithm to allocate services to the request in a better manner. Many…

Operating Systems · Computer Science 2014-03-04 Sourav Kumar Bhoi , Sanjaya Kumar Panda , Imran Hossain Faruk

Main memory database systems aim to provide users with low latency and high throughput access to data. Most data resides in secondary storage, which is limited by the access speed of the technology. For hot content, data resides in DRAM,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-29 Francisco Romero , Benjamin Braun , David Cheriton

With data sizes constantly expanding, and with classical machine learning algorithms that analyze such data requiring larger and larger amounts of computation time and storage space, the need to distribute computation and memory…

Machine Learning · Computer Science 2015-12-08 Aruna Govada , Shree Ranjani , Aditi Viswanathan , S. K. Sahay

Currently, Burst buffer has been proposed to manage the SSD buffering of bursty write requests. Although burst buffer can improve I/O performance in many cases, we find that it has some limitations such as requiring large SSD capacity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Xuanhua Shi , Wei Liu , Ligang He , Hai Jin , Ming Li , Yong Chen

We consider the problem of optimally allocating a given total storage budget in a distributed storage system. A source has a data object which it can code and store over a set of storage nodes; it is allowed to store any amount of coded…

Information Theory · Computer Science 2016-11-15 Derek Leong , Alexandros G. Dimakis , Tracey Ho

With the rapid development of cloud computing and big data technologies, storage systems have become a fundamental building block of datacenters, incorporating hardware innovations such as flash solid state drives and non-volatile memories,…

Databases · Computer Science 2023-08-01 Chenyuan Wu

We consider distributed on-device learning with limited communication and security requirements. We propose a new robust distributed optimization algorithm with efficient communication and attack tolerance. The proposed algorithm has…

Machine Learning · Computer Science 2019-10-03 Cong Xie , Sanmi Koyejo , Indranil Gupta

Similarity search is the task of retrieving data items that are similar to a given query. In this paper, we introduce the time-sensitive notion of similarity search over endless data-streams (SSDS), which takes into account data quality and…

Information Retrieval · Computer Science 2017-08-08 Naama Kraus , David Carmel , Idit Keidar

The distributed edge storage system can store data collected at the edge of the network in a decentralised manner, with low latency, high security, and flexibility. Traditional edge-distributed storage systems only consider one single…

Networking and Internet Architecture · Computer Science 2023-10-10 Yejin Yang , Miao Ye , Qiuxiang Jiang , Peng Wen

Algorithmic education theory examines, among other things, the trade-off between reviewing old material and studying new material: time spent learning the new comes at the expense of reviewing and solidifying one's understanding of the old.…

Chaotic Dynamics · Physics 2018-08-21 Joel Nishimura

In this paper we present efficient algorithmic solutions for several constrained resource allocation, management and discovery problems. We consider new types of resource allocation models and constraints, and we present new geometric…

Data Structures and Algorithms · Computer Science 2009-06-09 Mugurel Ionut Andreica , Madalina Ecaterina Andreica , Daniel Ardelean

Large-scale storage cluster systems need to manage a vast amount of data locations. A naive data locations management maintains pairs of data ID and nodes storing the data in tables. However, it is not practical when the number of pairs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-05 Ken-ichiro Ishikawa