中文
相关论文

相关论文: Improving Spark Application Throughput Via Memory …

200 篇论文

Reducing the average memory access time is crucial for improving the performance of applications running on multi-core architectures. With workload consolidation this becomes increasingly challenging due to shared resource contention.…

硬件体系结构 · 计算机科学 2021-02-24 Nadja Ramhöj Holtryd , Madhavan Manivannan , Per Stenström , Miquel Pericàs

The computation of the skyline provides a mechanism for utilizing multiple location-based criteria to identify optimal data points. However, the efficiency of these computations diminishes and becomes more challenging as the input data…

分布式、并行与集群计算 · 计算机科学 2024-04-05 Chen Li , Ye Zhu , Yang Cao , Jinli Zhang , Annisa Annisa , Debo Cheng , Yasuhiko Morimoto

We demonstrate that general-purpose memory allocation involving many threads on many cores can be done with high performance, multicore scalability, and low memory consumption. For this purpose, we have designed and implemented scalloc, a…

编程语言 · 计算机科学 2015-08-26 Martin Aigner , Christoph M. Kirsch , Michael Lippautz , Ana Sokolova

Performance modeling of parallel applications on multicore processors remains a challenge in computational co-design due to multicore processors' complex design. Multicores include complex private and shared memory hierarchies. We present a…

分布式、并行与集群计算 · 计算机科学 2021-03-26 Atanu Barai , Gopinath Chennupati , Nandakishore Santhi , Abdel-Hameed Badawy , Yehia Arafa , Stephan Eidenbenz

Most data analytics systems that require low-latency execution and efficient utilization of computing resources, increasingly adopt two computational paradigms, namely, incremental and approximate computing. Incremental computation updates…

分布式、并行与集群计算 · 计算机科学 2016-11-28 Dhanya R Krishnan

Approximate computing aims for efficient execution of workflows where an approximate output is sufficient instead of the exact output. The idea behind approximate computing is to compute over a representative sample instead of the entire…

分布式、并行与集群计算 · 计算机科学 2017-09-12 Do Le Quoc , Ruichuan Chen , Pramod Bhatotia , Christof Fetze , Volker Hilt , Thorsten Strufe

With the emergence of the big data age, the issue of how to obtain valuable knowledge from a dataset efficiently and accurately has attracted increasingly attention from both academia and industry. This paper presents a Parallel Random…

分布式、并行与集群计算 · 计算机科学 2019-11-26 Jianguo Chen , Kenli Li , Zhuo Tang , Kashif Bilal , Shui Yu , Chuliang Weng , Keqin Li

Serverless computing is increasingly adopted for its ability to manage complex, event-driven workloads without the need for infrastructure provisioning. However, traditional resource allocation in serverless platforms couples CPU and…

分布式、并行与集群计算 · 计算机科学 2025-03-03 Lingxiao Jin , Zinuo Cai , Zebin Chen , Hongyu Zhao , Ruhui Ma

Configuring a storage system to better serve an application is a challenging task complicated by a multidimensional, discrete configuration space and the high cost of space exploration (e.g., by running the application with different…

分布式、并行与集群计算 · 计算机科学 2013-06-11 Lauro Beltrão Costa , Abmar Barros , Samer Al-Kiswany , Hao Yang , Emalayan Vairavanathan , Matei Ripeanu

Large-scale data processing is increasingly done using distributed computing frameworks like Apache Spark, which have a considerable number of configurable parameters that affect runtime performance. For optimal performance, these…

分布式、并行与集群计算 · 计算机科学 2025-03-07 Raunaq Suri , Ilan Gofman , Guangwei Yu , Jesse C. Cresswell

Present day machine learning is computationally intensive and processes large amounts of data. It is implemented in a distributed fashion in order to address these scalability issues. The work is parallelized across a number of computing…

机器学习 · 计算机科学 2017-03-28 Alexander Ulanov , Andrey Simanovsky , Manish Marwah

Recent advancements in Large Language Models (LLMs) and autonomous agents have demonstrated remarkable capabilities across various domains. However, standalone agents frequently encounter limitations when handling complex tasks that demand…

计算与语言 · 计算机科学 2025-05-29 Rennai Qiu , Chen Qian , Ran Li , Yufan Dang , Weize Chen , Cheng Yang , Yingli Zhang , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Emerging smart grid applications analyze large amounts of data collected from millions of meters and systems to facilitate distributed monitoring and real-time control tasks. However, current parallel data processing systems are designed…

分布式、并行与集群计算 · 计算机科学 2023-02-03 Binquan Guo , Hongyan Li , Ye Yan , Zhou Zhang , Peng Wang

Algorithms for computing All-Pairs Shortest-Paths (APSP) are critical building blocks underlying many practical applications. The standard sequential algorithms, such as Floyd-Warshall and Johnson, quickly become infeasible for large input…

分布式、并行与集群计算 · 计算机科学 2019-08-08 Frank Schoeneman , Jaroslaw Zola

Caching networks are designed to reduce traffic load at backhaul links, by serving demands from edge-nodes. In the past decades, many studies have been done to address the caching problem. However, in practice, finding an optimal caching…

网络与互联网体系结构 · 计算机科学 2018-07-03 Elahe Rezaei , Hafez Eslami Manoochehri , Babak Hossein Khalaj

Memory disaggregation addresses memory imbalance in a cluster by decoupling CPU and memory allocations of applications while also increasing the effective memory capacity for (memory-intensive) applications beyond the local memory limit…

分布式、并行与集群计算 · 计算机科学 2022-02-07 Anil Yelam

As multimodal and AI-driven services exchange hundreds of megabytes per request, existing IPC runtimes spend a growing share of CPU cycles on memory copies. Although both hardware and software mechanisms are exploring memory offloading,…

操作系统 · 计算机科学 2026-01-13 Misun Park , Richi Dubey , Yifan Yuan , Nam Sung Kim , Ada Gavrilovska

With increasing point of interest (POI) datasets available with fine-grained spatial and temporal attributes, space-time Ripley's K function has been regarded as a powerful approach to analyze spatiotemporal point process. However,…

统计计算 · 统计学 2019-12-11 Yuan Wang , Zhipeng Gui , Huayi Wu , Dehua Peng , Jinghang Wu , Zousen Cui

The proliferation of big data and analytic workloads has driven the need for cloud compute and cluster-based job processing. With Apache Spark, users can process terabytes of data at ease with hundreds of parallel executors. At Microsoft,…

The Apache Spark stack has enabled fast large-scale data processing. Despite a rich library of statistical models and inference algorithms, it does not give domain users the ability to develop their own models. The emergence of…

数据库 · 计算机科学 2017-10-10 Zhuoyue Zhao , Jialing Pei , Eric Lo , Kenny Q. Zhu , Chris Liu