English
Related papers

Related papers: Improving Spark Application Throughput Via Memory …

200 papers

Mixture-of-Experts (MoE) has recently emerged as the mainstream architecture for efficiently scaling large language models while maintaining near-constant computational cost. Expert parallelism distributes parameters by partitioning experts…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Adrian Zhao , Zhenkun Cai , Zhenyu Song , Lingfan Yu , Haozheng Fan , Jun Wu , Yida Wang , Nandita Vijaykumar

To process data that do not fit in RAM, conventional wisdom would suggest using distributed approaches. However, recent research has demonstrated virtual memory's strong potential in scaling up graph mining algorithms on a single machine.…

Machine Learning · Computer Science 2016-04-12 Dezhi Fang , Duen Horng Chau

In many scenarios, such as emergency response or ad hoc collaboration, it is critical to reduce the overhead in integrating data. Ideally, one could perform the entire process interactively under one unified interface: defining extractors…

In this paper, we consider the service caching and the computing resource allocation in edge computing (EC) enabled networks. We introduce a random service caching design considering multiple types of latency sensitive services and the base…

Networking and Internet Architecture · Computer Science 2023-01-20 Mingun Kim , Hewon Cho , Ying Cui , Jemin Lee

Task-based programming models are excellent tools to parallelize and seamlessly load balance an application workload. However, the integration of I/O intensive applications and task-based programming models is lacking. Typically, I/O…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-30 Aleix Roca Nonell , Vicenç Beltran Querol , Sergi Mateo Bellido

Remote memory techniques for datacenter applications have recently gained a great deal of popularity. Existing remote memory techniques focus on the efficiency of a single application setting only. However, when multiple applications co-run…

Operating Systems · Computer Science 2022-10-13 Chenxi Wang , Yifan Qiao , Haoran Ma , Shi Liu , Yiying Zhang , Wenguang Chen , Ravi Netravali , Miryung Kim , Guoqing Harry Xu

The applications being developed within the U.S. Exascale Computing Project (ECP) to run on imminent Exascale computers will generate scientific results with unprecedented fidelity and record turn-around time. Many of these codes are based…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Lipeng Wan , Axel Huebl , Junmin Gu , Franz Poeschel , Ana Gainaru , Ruonan Wang , Jieyang Chen , Xin Liang , Dmitry Ganyushin , Todd Munson , Ian Foster , Jean-Luc Vay , Norbert Podhorszki , Kesheng Wu , Scott Klasky

State-of-the-art distributed stream processing systems such as Apache Flink and Storm have recently included checkpointing to provide fault-tolerance for stateful applications. This is a necessary eventuality as these systems head into the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Sachini Jayasekara , Aaron Harwood , Shanika Karunasekera

With the advent of internet services, data started growing faster than it can be processed. To personalize user experience, this enormous data has to be processed in real time, in interactive fashion. In order to achieve faster data…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-21 Sundeep Kambhampati , Christopher Stewart

With the growing demand for latency-critical and computation-intensive Internet of Things (IoT) services, the IoT-oriented network architecture, mobile edge computing (MEC), has emerged as a promising technique to reinforce the computation…

Information Theory · Computer Science 2022-08-09 Jiechen Chen , Hong Xing , Xiaohui Lin , Arumugam Nallanathan , Suzhi Bi

Big data applications and analytics are employed in many sectors for a variety of goals: improving customers satisfaction, predicting market behavior or improving processes in public health. These applications consist of complex software…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-30 Alexandre Maros , Fabricio Murai , Ana Paula Couto da Silva , Jussara M. Almeida , Marco Lattuada , Eugenio Gianniti , Marjan Hosseini , Danilo Ardagna

The continued growth of the computational capability of throughput processors has made throughput processors the platform of choice for a wide variety of high performance computing applications. Graphics Processing Units (GPUs) are a prime…

Hardware Architecture · Computer Science 2018-05-01 Rachata Ausavarungnirun

Distributed Stream Processing Systems (DSPS) like Apache Storm and Spark Streaming enable composition of continuous dataflows that execute persistently over data streams. They are used by Internet of Things (IoT) applications to analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Shilpa Chaturvedi , Sahil Tyagi , Yogesh Simmhan

Mobile edge computing (MEC) enables low-latency and high-bandwidth applications by bringing computation and data storage closer to end-users. Intelligent computing is an important application of MEC, where computing resources are used to…

Networking and Internet Architecture · Computer Science 2023-07-10 Yuanpeng Zheng , Tiankui Zhang , Jonathan Loo , Yapeng Wang , Arumugam Nallanathan

Cutting-edge embedded system applications, such as self-driving cars and unmanned drone software, are reliant on integrated CPU/GPU platforms for their DNNs-driven workload, such as perception and other highly parallel components. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-20 Soroush Bateni , Zhendong Wang , Yuankun Zhu , Yang Hu , Cong Liu

With the increasing amount of data available to scientists in disciplines as diverse as bioinformatics, physics, and remote sensing, scientific workflow systems are becoming increasingly important for composing and executing scalable data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-20 Jonathan Bader , Nils Diedrich , Lauritz Thamsen , Odej Kao

Serverless computing paradigm has become more ingrained into the industry, as it offers a cheap alternative for application development and deployment. This new paradigm has also created new kinds of problems for the developer, who needs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-14 Gor Safaryan , Anshul Jindal , Mohak Chadha , Michael Gerndt

Accurate prediction of application performance is critical for enabling effective scheduling and resource management in resource-constrained dynamic edge environments. However, achieving predictable performance in such environments remains…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-24 Panagiotis Giannakopoulos , Bart van Knippenberg , Kishor Chandra Joshi , Nicola Calabretta , George Exarchakos

When processing data streams with highly skewed and nonstationary key distributions, we often observe overloaded partitions when the hash partitioning fails to balance data correctly. To avoid slow tasks that delay the completion of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-01 Zoltán Zvara , Péter G. N. Szabó , Balázs Barnabás Lóránt , András A. Benczúr

This paper presents a benchmark of stream processing throughput comparing Apache Spark Streaming (under file-, TCP socket- and Kafka-based stream integration), with a prototype P2P stream processing framework, HarmonicIO. Maximum throughput…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-20 Ben Blamey , Andreas Hellander , Salman Toor