English
Related papers

Related papers: Skyhook: Towards an Arrow-Native Storage System

200 papers

We present GeoRocket, a software for the management of very large geospatial datasets in the cloud. GeoRocket employs a novel way to handle arbitrarily large datasets by splitting them into chunks that are processed individually. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-04 Michel Krämer

The data engineering and data science community has embraced the idea of using Python & R dataframes for regular applications. Driven by the big data revolution and artificial intelligence, these applications are now essential in order to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-20 Niranda Perera , Kaiying Shan , Supun Kamburugamuwe , Thejaka Amila Kanewela , Chathura Widanage , Arup Sarker , Mills Staylor , Tianle Zhong , Vibhatha Abeykoon , Geoffrey Fox

Serverless edge computing adopts an event-based paradigm that provides back-end services on an as-used basis, resulting in efficient resource utilization. To improve the end-to-end latency and revenue, service providers need to optimize the…

Networking and Internet Architecture · Computer Science 2023-10-09 Chen Chen , Manuel Herrera , Ge Zheng , Liqiao Xia , Zhengyang Ling , Jiangtao Wang

The trend of massive connectivity pushes forward the explosive growth of end devices. The emergence of various applications has prompted a demand for pervasive connectivity and more efficient computing paradigms. On the other hand, the lack…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin

Recent advances in foundation models have transformed LLMs from passive conversational systems into autonomous agents capable of reasoning and tool execution. While these capabilities unlock substantial practical value, they also introduce…

Cryptography and Security · Computer Science 2026-05-25 Zhe Liu , Zonghao Ying , Wenxin Zhang , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Hao Peng

Memory latencies and bandwidth are major factors, limiting system performance and scalability. Modern CPUs aim at hiding latencies by employing large caches, out-of-order execution, or complex hardware prefetchers. However, software-based…

Databases · Computer Science 2025-06-23 Arthur Bernhardt , Sajjad Tamimi , Florian Stock , Andreas Koch , Ilia Petrov

With the continuous growth of mobile data and the unprecedented demand for computing power, resource-constrained edge devices cannot effectively meet the requirements of Internet of Things (IoT) applications and Deep Neural Network (DNN)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-02 Guanjin Qu , Huaming Wu

In the age of big data, information security has become a major issue of debate, especially with the rise of the Internet of Things (IoT), where attackers can effortlessly obtain physical access to edge devices. The hash algorithm is the…

Cryptography and Security · Computer Science 2022-08-17 Jingyao Zhang , Elaheh Sadredini

The Storage Location Assignment Problem (SLAP) and the Picker Routing Problem (PRP) have received significant attention in the literature due to their pivotal role in the performance of the Order Picking (OP) activity, the most…

Discrete Mathematics · Computer Science 2024-07-19 Thibault Prunet , Nabil Absi , Diego Cattaruzza

The data science community today has embraced the concept of Dataframes as the de facto standard for data representation and manipulation. Ease of use, massive operator coverage, and popularization of R and Python languages have heavily…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-06 Niranda Perera , Supun Kamburugamuve , Chathura Widanage , Vibhatha Abeykoon , Ahmet Uyar , Kaiying Shan , Hasara Maithree , Damitha Lenadora , Thejaka Amila Kanewala , Geoffrey Fox

With the exponential growth of data and evolving use cases, petabyte-scale OLAP data platforms are increasingly adopting a model that decouples compute from storage. This shift, evident in organizations like Uber and Meta, introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Chunxu Tang , Bin Fan , Jing Zhao , Chen Liang , Yi Wang , Beinan Wang , Ziyue Qiu , Lu Qiu , Bowen Ding , Shouzhuo Sun , Saiguang Che , Jiaming Mai , Shouwei Chen , Yu Zhu , Jianjian Xie , Yutian , Sun , Yao Li , Yangjun Zhang , Ke Wang , Mingmin Chen

The Internet of Things (IoT) bears unprecedented security and scalability challenges due to the magnitude of data produced and exchanged by IoT devices and platforms. Some of those challenges are currently being addressed by coupling IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-27 Hien Thi Thu Truong , Miguel Almeida , Ghassan Karame , Claudio Soriente

Shared memory multiprocessors come back to popularity thanks to rapid spreading of commodity multi-core architectures. As ever, shared memory programs are fairly easy to write and quite hard to optimise; providing multi-core programmers…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-09-10 Marco Aldinucci , Massimo Torquati , Massimiliano Meneghin

Edge computing is an emerging paradigm to enable low-latency applications, like mobile augmented reality, because it takes the computation on processing devices that are closer to the users. On the other hand, the need for highly scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Claudio Cicconetti , Marco Conti , Andrea Passarella

Parallel shared-nothing data management systems have been widely used to exploit a cluster of machines for efficient and scalable data processing. When a cluster needs to be dynamically scaled in or out, data must be efficiently rebalanced.…

Databases · Computer Science 2021-05-25 Chen Luo , Michael J. Carey

Memory allocation, though constituting only a small portion of the executed code, can have a "butterfly effect" on overall program performance, leading to significant and far-reaching impacts. Despite accounting for just approximately 5% of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Ruihao Li , Qinzhe Wu , Krishna Kavi , Gayatri Mehta , Jonathan C. Beard , Neeraja J. Yadwadkar , Lizy K. John

High-Performance Computing (HPC) applications need to checkpoint massive amounts of data at scale. Multi-level asynchronous checkpoint runtimes like VELOC (Very Low Overhead Checkpoint Strategy) are gaining popularity among application…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-07 Mikaila J. Gossman , Bogdan Nicolae , Jon C. Calhoun , Franck Cappello , Melissa C. Smith

Mobile Edge Computing (MEC) is a promising approach for enhancing the quality-of-service (QoS) of AI-enabled applications in the B5G/6G era, by bringing computation capability closer to end-users at the network edge. In this work, we…

Networking and Internet Architecture · Computer Science 2025-11-25 Huaizhe Liu , Jiaqi Wu , Zhizongkai Wang , Bin Cao , Lin Gao

The Internet of Things is an example domain where data is perpetually generated in ever-increasing quantities, reflecting the proliferation of connected devices and the formation of continuous data streams over time. Consequently, the…

Attacks on the microarchitecture of modern processors have become a practical threat to security and privacy in desktop and cloud computing. Recently, cache attacks have successfully been demonstrated on ARM based mobile devices, suggesting…

Cryptography and Security · Computer Science 2017-03-30 Marc Green , Leandro Rodrigues-Lima , Andreas Zankl , Gorka Irazoqui , Johann Heyszl , Thomas Eisenbarth