English
Related papers

Related papers: Should I Hide My Duck in the Lake?

200 papers

High-performance clusters and datacenters pose increasingly demanding requirements on storage systems. If these systems do not operate at scale, applications are doomed to become I/O bound and waste compute cycles. To accelerate the data…

Networking and Internet Architecture · Computer Science 2022-06-22 Salvatore Di Girolamo , Daniele De Sensi , Konstantin Taranov , Milos Malesevic , Maciej Besta , Timo Schneider , Severin Kistler , Torsten Hoefler

The paradigm of big data is characterized by the need to collect and process data sets of great volume, arriving at the systems with great velocity, in a variety of formats. Spark is a widely used big data processing system that can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-29 Duarte M. Nascimento , Miguel Ferreira , Miguel L. Pardal

We present FLIC, a distributed software data caching framework for fogs that reduces network traffic and latency. FLICis targeted toward city-scale deployments of cooperative IoT devices in which each node gathers and shares data with…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Jack West , Neil Kingensmith , George K. Thiruvathukal

Distributed in-memory data processing engines accelerate iterative applications by caching substantial datasets in memory rather than recomputing them in each iteration. Selecting a suitable cluster size for caching these datasets plays an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-07 Hani Al-Sayeh , Muhammad Attahir Jibril , Bunjamin Memishi , Kai-Uwe Sattler

The recent influx of open scientific data has contributed to the transitioning of scientific computing from compute intensive to data intensive. Whereas many Big Data frameworks exist that minimize the cost of data transfers, few scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-06 Valérie Hayot-Sasson , Mathieu Dugré , Tristan Glatard

The proliferation of big data and analytic workloads has driven the need for cloud compute and cluster-based job processing. With Apache Spark, users can process terabytes of data at ease with hundreds of parallel executors. At Microsoft,…

In cloud data platforms, developers often encounter performance regressions that occur in specific tenant datasets. However, due to confidentiality constraints, they cannot access the original data, which makes it difficult to reproduce…

Databases · Computer Science 2026-05-29 Donghyun Sohn , Jennie Rogers

High-performance computing (HPC) researchers have long envisioned scenarios where application workflows could be improved through the use of programmable processing elements embedded in the network fabric. Recently, vendors have introduced…

Networking and Internet Architecture · Computer Science 2021-05-17 Jianshen Liu , Carlos Maltzahn , Craig Ulmer , Matthew Leon Curry

Minimizing total link cost in Information-Centric Network (ICN) by optimizing content placement is challenging in both effectiveness and practicality. To attain better performance, upstream link cost caused by a cache miss should be…

Networking and Internet Architecture · Computer Science 2018-11-15 Lemei Huang , Yu Guan , Xinggong Zhang , Zongming Guo

The growing volumes of data being collected and its analysis to provide better services are creating worries about digital privacy. To address privacy concerns and give practical solutions, the literature has relied on secure multiparty…

Cryptography and Security · Computer Science 2022-06-27 Nishat Koti , Shravani Patil , Arpita Patra , Ajith Suresh

Host CPU resources are heavily consumed by TCP stack processing, limiting scalability in data centers. Existing offload methods typically address only partial functionality or lack flexibility. This paper introduces PnO (Plug & Offload), an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-01 Hailong Nan , Zhe Zhou , Min Yang

Eliminating duplicate data in primary storage of clouds increases the cost-efficiency of cloud service providers as well as reduces the cost of users for using cloud services. Existing primary deduplication techniques either use inline…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Huijun Wu , Chen Wang , Yinjin Fu , Sherif Sakr , Liming Zhu , Kai Lu

Organizations use data lakes to store and analyze sensitive data. But hackers may compromise data lake storage to bypass access controls and access sensitive data. To address this, we propose Membrane, a system that (1) cryptographically…

Cryptography and Security · Computer Science 2025-09-11 Sam Kumar , Samyukta Yagati , Conor Power , David E. Culler , Raluca Ada Popa

Today's datacenter applications rely on datastores that are required to provide high availability, consistency, and performance. To achieve high availability, these datastores replicate data across several nodes. Such replication is managed…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-25 M. R. Siavash Katebzadeh , Antonios Katsarakis , Boris Grot

SmartNIC Data Processing Units (DPUs) offer a promising solution for saving high-end CPU resources by offloading tasks to programmable cores near the network interface. In this work, we explore the feasibility of SmartNIC DPUs in supporting…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-25 Jacob Wahlgren , Andong Hu , Roger Pearce , Maya Gokhale , Ivy Peng

Network speeds grow quickly in the modern cloud, so SmartNICs are introduced to offload network processing tasks, even application logic. However, typical multicore SmartNICs such as BlueFiled-2 are only capable of processing control-plane…

Networking and Internet Architecture · Computer Science 2024-09-10 Xuzheng Chen , Jie Zhang , Ting Fu , Yifan Shen , Shu Ma , Kun Qian , Lingjun Zhu , Chao Shi , Yin Zhang , Ming Liu , Zeke Wang

Data lakes have emerged as a flexible and scalable solution for storing and analyzing large volumes of heterogeneous data, including structured, semi-structured, and unstructured formats. Despite their growing adoption in both industry and…

Databases · Computer Science 2026-01-28 Yi Lyu , Pei-Chieh Lo , Natan Lidukhover

High-performance computing (HPC) requires resilience techniques such as checkpointing in order to tolerate failures in supercomputers. As the number of nodes and memory in supercomputers keeps on increasing, the size of checkpoint data also…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-13 Kai Keller , Leonardo Bautista Gomez

Today, deep learning is an essential technology for our life. To solve more complex problems with deep learning, both sizes of training datasets and neural networks are increasing. To train a model with large datasets and networks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-05 Takaaki Fukai , Kento Sato , Takahiro Hirofuchi

Hash tables are an essential data-structure for numerous networking applications (e.g., connection tracking, firewalls, network address translators). Among these, cuckoo hash tables provide excellent performance by allowing lookups to be…

Networking and Internet Architecture · Computer Science 2017-12-29 Nicolas Le Scouarnec