中文
相关论文

相关论文: Improving a High Productivity Data Analytics Chape…

200 篇论文

Edge inference is a technology that enables real-time data processing and analysis on clients near the data source. To ensure compliance with the Service-Level Objectives (SLOs), such as a 30% latency reduction target, caching is usually…

分布式、并行与集群计算 · 计算机科学 2024-12-17 Wenyi Liang , Jianchun Liu , Hongli Xu , Chunming Qiao , Liusheng Huang

Dynamically typed languages such as Python have become very popular. Among other strengths, Python's dynamic nature and its straightforward linking to native code have made it the de-facto language for many research areas such as Artificial…

编程语言 · 计算机科学 2023-01-13 Wenting Zhao , Ibrahim Abdelaziz , Julian Dolby , Kavitha Srinivas , Mossad Helali , Essam Mansour

Within the last years, Python became more prominent in the scientific community and is now used for simulations, machine learning, and data analysis. All these tasks profit from additional compute power offered by parallelism and…

分布式、并行与集群计算 · 计算机科学 2021-10-26 Andreas Gocht , Robert Schöne , Jan Frenzel

The promise of ultimate elasticity and operational simplicity of serverless computing has recently lead to an explosion of research in this area. In the context of data analytics, the concept sounds appealing, but due to the limitations of…

数据库 · 计算机科学 2020-05-11 Ingo Müller , Renato Marroquín , Gustavo Alonso

We develop a framework for computing two foundational analyses for concurrent higher-order programs: (control-)flow analysis (CFA) and may-happen-in-parallel analysis (MHP). We pay special attention to the unique challenges posed by the…

编程语言 · 计算机科学 2011-06-15 Matthew Might , David Van Horn

Today's large-scale services (e.g., video streaming platforms, data centers, sensor grids) need diverse real-time summary statistics across multiple subpopulations of multidimensional datasets. However, state-of-the-art frameworks do not…

数据库 · 计算机科学 2022-08-10 Antonis Manousis , Zhuo Cheng , Ran Ben Basat , Zaoxing Liu , Vyas Sekar

In the era of big data and cloud computing, large amounts of data are generated from user applications and need to be processed in the datacenter. Data-parallel computing frameworks, such as Apache Spark, are widely used to perform such…

性能 · 计算机科学 2018-05-09 Zhengyu Yang , Danlin Jia , Stratis Ioannidis , Ningfang Mi , Bo Sheng

The Apache Spark framework for distributed computation is popular in the data analytics community due to its ease of use, but its MapReduce-style programming model can incur significant overheads when performing computations that do not map…

分布式、并行与集群计算 · 计算机科学 2018-06-06 Alex Gittens , Kai Rothauge , Shusen Wang , Michael W. Mahoney , Jey Kottalam , Lisa Gerhardt , Prabhat , Michael Ringenburg , Kristyn Maschhoff

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code -- supporting symbolic, graph-based Deep Neural Network (DNN)…

软件工程 · 计算机科学 2025-10-07 Raffi Khatchadourian , Tatiana Castro Vélez , Mehdi Bagherzadeh , Nan Jia , Anita Raja

Beowulf clusters are very popular and deployed worldwide in support of scientific computing, because of the high computational power and performance. However, they also pose several challenges, and yet they need to provide high…

性能 · 计算机科学 2019-07-19 Yonal Kirsal , Yoney Kirsal Ever

While cluster computing frameworks are continuously evolving to provide real-time data analysis capabilities, Apache Spark has managed to be at the forefront of big data analytics for being a unified framework for both, batch and stream…

分布式、并行与集群计算 · 计算机科学 2016-04-29 Ahsan Javed Awan , Mats Brorsson , Vladimir Vlassov , Eduard Ayguade

Today's data analytics frameworks are compute-centric, with analytics execution almost entirely dependent on the pre-determined physical structure of the high-level computation. Relegating intermediate data to a second class entity in this…

分布式、并行与集群计算 · 计算机科学 2019-06-24 Robert Grandl , Arjun Singhvi , Raajay Viswanathan , Aditya Akella

The use of approximation is fundamental in computational science. Almost all computational methods adopt approximations in some form in order to obtain a favourable cost/accuracy trade-off and there are usually many approximations that…

分布式、并行与集群计算 · 计算机科学 2022-06-14 Michael A. Johnston , Vassilis Vassiliadis

Serverless computing has emerged as a pivotal paradigm for deploying Deep Learning (DL) models, offering automatic scaling and cost efficiency. However, the inherent cold start problem in serverless ML inference systems, particularly the…

分布式、并行与集群计算 · 计算机科学 2025-07-01 Z. Wu , Y. Deng , J. Hu , L. Cui , Z. Zhang , L. Zeng , G. Min

To process data more efficiently, big data frameworks provide data abstractions to developers. However, due to the abstraction, there may be many challenges for developers to understand and debug the data processing code. To uncover the…

软件工程 · 计算机科学 2021-03-29 Zehao Wang

In GPU-accelerated data analytics, the overhead of data transfer from CPU to GPU becomes a performance bottleneck when the data scales beyond GPU memory capacity due to the limited PCIe bandwidth. Data compression has come to rescue for…

数据库 · 计算机科学 2026-02-10 Gwangoo Yeo , Zhiyang Shen , Wei Cui , Matteo Interlandi , Rathijit Sen , Bailu Ding , Qi Chen , Minsoo Rhu

OODIDA (On-board/Off-board Distributed Data Analytics) is a platform for distributing and executing concurrent data analytics tasks. It targets fleets of reference vehicles in the automotive industry and has a particular focus on rapid…

分布式、并行与集群计算 · 计算机科学 2020-09-17 Gregor Ulm , Emil Gustavsson , Mats Jirstrand

The CERN IT provides a set of Hadoop clusters featuring more than 5 PBytes of raw storage with different open-source, user-level tools available for analytical purposes. The CMS experiment started collecting a large set of computing…

数据分析、统计与概率 · 物理学 2017-11-03 Marco Meoni , Valentin Kuznetsov , Luca Menichetti , Justinas Rumševičius , Tommaso Boccali , Daniele Bonacorsi

Data processing pipelines represent an important slice of the astronomical software library that include chains of processes that transform raw data into valuable information via data reduction and analysis. In this work we present Corral,…

天体物理仪器与方法 · 物理学 2017-08-09 Juan B. Cabral , Bruno Sánchez , Martín Beroiz , Mariano Domínguez , Marcelo Lares , Sebastián Gurovich , Pablo Granitto

The growing complexity and scale of scientific workflows in high performance computing (HPC) environments have led to significant challenges in managing energy consumption without compromising computational performance. Traditional…

分布式、并行与集群计算 · 计算机科学 2026-05-25 Ali Zahir , Ashiq Anjum , Mark Wilkinson , Jeyan Thiyagalingam