English
Related papers

Related papers: Performance comparison of Dask and Apache Spark on…

200 papers

This paper contributes towards better understanding the energy consumption trade-offs of HPC scale Artificial Intelligence (AI), and more specifically Deep Learning (DL) algorithms. For this task we developed benchmark-tracker, a benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-02 Danilo Carastan dos Santos

The heterogeneous computing paradigm has led to the need for portable and efficient programming solutions that can leverage the capabilities of various hardware devices, such as NVIDIA, Intel, and AMD GPUs. This study evaluates the…

Programming Languages · Computer Science 2023-11-13 Manuel Costanzo , Enzo Rucci , Carlos García Sánchez , Marcelo Naiouf , Manuel Prieto-Matías

Pipeline parallelism (PP) when training neural networks enables larger models to be partitioned spatially, leading to both lower network communication and overall higher hardware utilization. Unfortunately, to preserve the statistical…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Bowen Yang , Jian Zhang , Jonathan Li , Christopher Ré , Christopher R. Aberger , Christopher De Sa

Many scientific data sets contain temporal dimensions. These are the data storing information at the same spatial location but different time stamps. Some of the biggest temporal datasets are produced by parallel computing applications such…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-13 Zheng Yuan , William Hendrix , Seung Woo Son , Christoph Federrath , Ankit Agrawal , Wei-keng Liao , Alok Choudhary

Artificial Intelligence (AI) workloads drive a rapid expansion of high-performance computing (HPC) infrastructures and increase their power and energy demands towards a critical level. AI benchmarks representing state-of-the art workloads…

Performance · Computer Science 2026-03-18 Martin Mayr , Sebastian Wind , Lukas Schröder , Georg Hager , Harald Köstler , Gerhard Wellein

The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide.…

Big, fine-grained enterprise registration data that includes time and location information enables us to quantitatively analyze, visualize, and understand the patterns of industries at multiple scales across time and space. However, data…

Computers and Society · Computer Science 2018-05-23 Fa Li , Zhipeng Gui , Huayi Wu , Jianya Gong , Yuan Wang , Siyu Tian , Jiawen Zhang

One of the hardest challenges of the current Big Data landscape is the lack of ability to process huge volumes of information in an acceptable time. The goal of this work, is to ascertain if it is useful to use typical Big Data tools to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-08 Adrian Bazaga , Michal Pitonak

Experimental Particle Physics has been at the forefront of analyzing the worlds largest datasets for decades. The HEP community was the first to develop suitable software and computing tools for this task. In recent times, new toolkits and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-23 Oliver Gutsche , Matteo Cremonesi , Peter Elmer , Bo Jayatilaka , Jim Kowalkowski , Jim Pivarski , Saba Sehrish , Cristina Mantilla Surez , Alexey Svyatkovskiy , Nhan Tran

In the big data era of observational oceanography, passive acoustics datasets are becoming too high volume to be processed on local computers due to their processor and memory limitations. As a result there is a current need for our…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-10 Paul Nguyen Hong Duc , Dorian Cazau

We consider big spatial data, which is typically produced in scientific areas such as geological or seismic interpretation. The spatial data can be produced by observation (e.g. using sensors or soil instrument) or numerical simulation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-09 Ji Liu , Noel Moreno Lemus , Esther Pacitti , Fabio Porto , Patrick Valduriez

Scientific applications are often complex, irregular, and computationally-intensive. To accommodate the ever-increasing computational demands of scientific applications, high-performance computing (HPC) systems have become larger and more…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-20 Ali Mohammed , Aurelien Cavelan , Florina M. Ciorba , Ruben M. Cabezon , Ioana Banicesu

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

For image-related deep learning tasks, the first step often involves reading data from external storage and performing preprocessing on the CPU. As accelerator speed increases and the number of single compute node accelerators increases,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Jia Wei , Xingjun Zhang , Witold Pedrycz , Longxiang Wang , Jie Zhao

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Understanding how the brain functions is one of the biggest challenges of our time. The analysis of experimentally recorded neural firing patterns (spike trains) plays a crucial role in addressing this problem. Here, the PySpike library is…

Data Analysis, Statistics and Probability · Physics 2016-07-12 Mario Mulansky , Thomas Kreuz

The growing volume of data in scientific domains has made spatial query processing increasingly challenging due to high data transfer costs across the memory hierarchy and limited memory bandwidth. To address these bottlenecks and reduce…

Databases · Computer Science 2026-04-17 Tasmia Jannat , Michael Gowanlock , Satish Puri

Computer-science-oriented artificial neural networks (ANNs) have achieved tremendous success in a variety of scenarios via powerful feature extraction and high-precision data operations. It is well known, however, that ANNs usually suffer…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Zheyu Yang , Yujie Wu , Guanrui Wang , Yukuan Yang , Guoqi Li , Lei Deng , Jun Zhu , Luping Shi

We profile the impact of computation and inter-processor communication on the energy consumption and on the scaling of cortical simulations approaching the real-time regime on distributed computing platforms. Also, the speed and energy…

We present SPDL (Scalable and Performant Data Loading), an open-source, framework-agnostic library designed for efficiently loading array data to GPU. Data loading is often a bottleneck in AI applications, and is challenging to optimize…