English
Related papers

Related papers: M3R: Increased performance for in-memory Hadoop jo…

200 papers

MapReduce is becoming the de facto framework for storing and processing massive data, due to its excellent scalability, reliability, and elasticity. In many MapReduce applications, obtaining a compact accurate summary of data is essential.…

Databases · Computer Science 2011-11-01 Jeffrey Jestes , Ke Yi , Feifei Li

Recent nano-technological advances enable the Monolithic 3D (M3D) integration of multiple memory and logic layers in a single chip, allowing for fine-grained connections between layers and significantly alleviating main memory bottlenecks.…

MapReduce has been widely applied in various fields of data and compute intensive applications and also it is important programming model for cloud computing. Hadoop is an open-source implementation of MapReduce which operates on terabytes…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-01 Sayalee Narkhede , Trupti Baraskar , Debajyoti Mukhopadhyay

Hadoop MapReduce is a framework for distributed storage and processing of large datasets that is quite popular in big data analytics. It has various configuration parameters (knobs) which play an important role in deciding the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-28 Sandeep Kumar , Sindhu Padakandla , Chandrashekar L , Priyank Parihar , K Gopinath , Shalabh Bhatnagar

Large Language Models (LLMs) increasingly require processing long text sequences, but GPU memory limitations force difficult trade-offs between memory capacity and bandwidth. While HBM-based acceleration offers high bandwidth, its capacity…

Hardware Architecture · Computer Science 2025-04-25 Qingyuan Liu , Liyan Chen , Yanning Yang , Haocheng Wang , Dong Du , Zhigang Mao , Naifeng Jing , Yubin Xia , Haibo Chen

Large Language Models (LLMs) have demonstrated remarkable abilities in various language tasks, making them promising candidates for decision-making in robotics. Inspired by Hierarchical Reinforcement Learning (HRL), we propose…

Robotics · Computer Science 2024-10-07 Chuanneng Sun , Songjun Huang , Dario Pompili

Understanding the performance of data-parallel workloads when resource-constrained has significant practical importance but unfortunately has received only limited attention. This paper identifies, quantifies and demonstrates memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-15 Calin Iorgulescu , Florin Dinu , Aunn Raza , Wajih Ul Hassan , Willy Zwaenepoel

Task execution quality significantly impacts multi-robot missions, yet existing task allocation frameworks rarely consider quality of service as a decision variable, despite its importance in applications like robotic disinfection and…

Robotics · Computer Science 2025-10-09 Ishaan Mehta , Junseo Kim , Sharareh Taghipour , Sajad Saeedi

It is cost-efficient for a tenant with a limited budget to establish a virtual MapReduce cluster by renting multiple virtual private servers (VPSs) from a VPS provider. To provide an appropriate scheduling scheme for this type of computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-12 Ming-Chang Lee , Jia-Chun Lin , Ramin Yahyapour

Large Language Models (LLMs) with Mixture-of-Expert (MoE) architectures achieve superior model performance with reduced computation costs, but at the cost of high memory capacity and bandwidth requirements. Near-Memory Processing (NMP)…

Performance · Computer Science 2025-09-12 Haochen Huang , Shuzhang Zhong , Zhe Zhang , Shuangchen Li , Dimin Niu , Hongzhong Zheng , Runsheng Wang , Meng Li

Minimum-Storage Regenerating (MSR) codes have emerged as a viable alternative to Reed-Solomon (RS) codes as they minimize the repair bandwidth while they are still optimal in terms of reliability and storage overhead. Although several MSR…

Information Theory · Computer Science 2020-02-14 Katina Kralevska , Danilo Gligoroski , Rune E. Jensen , Harald Øverby

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Monte Carlo simulations employed for the analysis of portfolios of catastrophic risk process large volumes of data. Often times these simulations are not performed in real-time scenarios as they are slow and consume large data. Such…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-25 Zhimin Yao , Blesson Varghese , Andrew Rau-Chaplin

The growing data has brought tremendous pressure for query processing and storage, so there are many studies that focus on using GPU to accelerate join operation, which is one of the most important operations in modern database systems.…

Databases · Computer Science 2019-04-26 Hongzhi Wang , Ning Li , Zheng Wang , Jianing Li

Scheduling deep learning (DL) models to train on powerful clusters with accelerators like GPUs and TPUs, presently falls short, either lacking fine-grained heterogeneity awareness or leaving resources substantially under-utilized. To fill…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-17 Abeda Sultana , Nabin Pakka , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

In the era of diminishing returns from Moores Law, heterogeneous computing systems have emerged as a vital approach to enhance computational efficiency. This paper introduces a novel MLIR-based dialect, named hyper, designed to optimize…

Cryptography and Security · Computer Science 2025-06-05 Zhiyuan Tan , Liutong Han , Mingjie Xing , Yanjun Wu

Adaptive workloads can change on--the--fly the configuration of their jobs, in terms of number of processes. In order to carry out these job reconfigurations, we have designed a methodology which enables a job to communicate with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Sergio Iserte , Rafael Mayo , Enrique S. Quintana-Orti , Vicenc Beltran , Antonio J. Peña

Memory plays a key role in enhancing LLMs' performance when deployed to real-world applications. Existing solutions face trade-offs: explicit memory designs based on external storage require complex management and incur storage overhead,…

Computation and Language · Computer Science 2025-02-25 Xiaoqiang Wang , Suyuchen Wang , Yun Zhu , Bang Liu

Indexes are critical for efficient data retrieval and updates in modern databases. Recent advances in machine learning have led to the development of learned indexes, which model the cumulative distribution function of data to predict…

Databases · Computer Science 2026-04-27 Xinyi Zhang , Liang Liang , Anastasia Ailamaki , Jianliang Xu

In this paper we investigate an emerging application, 3D scene understanding, likely to be significant in the mobile space in the near future. The goal of this exploration is to reduce execution time while meeting our quality of result…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Luigi Nardi , Bruno Bodin , Sajad Saeedi , Emanuele Vespa , Andrew J. Davison , Paul H. J. Kelly