English
Related papers

Related papers: Optimizing Cloud-to-GPU Throughput for Deep Learni…

200 papers

In the last decades, the computational power of GPUs has grown exponentially, allowing current deep learning (DL) applications to handle increasingly large amounts of data at a progressively higher throughput. However, network and storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-08 Francesco Versaci , Giovanni Busonera

The goal of hyperparameter tuning (or hyperparameter optimization) is to optimize the hyperparameters to improve the performance of the machine or deep learning model. spotPython (``Sequential Parameter Optimization Toolbox in Python'') is…

Machine Learning · Computer Science 2023-06-08 Thomas Bartz-Beielstein

Training large language models requires extensive processing, made possible by many high-performance computing resources. This study compares multi-node and multi-GPU environments for training large language models of electrocardiograms. It…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Dimitar Mileski , Nikola Petrovski , Marjan Gusev

Most deep neural networks deployed today are trained using GPUs via high-level frameworks such as TensorFlow and PyTorch. This paper describes changes we made to the GPGPU-Sim simulator to enable it to run PyTorch by running PTX kernels…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-29 Jonathan Lew , Deval Shah , Suchita Pati , Shaylin Cattell , Mengchi Zhang , Amruth Sandhupatla , Christopher Ng , Negar Goli , Matthew D. Sinclair , Timothy G. Rogers , Tor Aamodt

Smart and agile drones are fast becoming ubiquitous at the edge of the cloud. The usage of these drones are constrained by their limited power and compute capability. In this paper, we present a Transfer Learning (TL) based approach to…

Machine Learning · Computer Science 2019-10-15 Aqeel Anwar , Arijit Raychowdhury

State-of-the-art deep learning systems such as TensorFlow and PyTorch tightly couple the model with the underlying hardware. This coupling requires the user to modify application logic in order to run the same job across a different set of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-13 Andrew Or , Haoyu Zhang , Michael J. Freedman

Self-supervised learning (SSL) has enabled the development of vision foundation models for Earth Observation (EO), demonstrating strong transferability across diverse remote sensing tasks. While prior work has focused on network…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Thomas Kerdreux , Alexandre Tuel , Quentin Febvre , Alexis Mouche , Bertrand Chapron

Edge Video Analytics (EVA) has gained significant attention as a major application of pervasive computing, enabling real-time visual processing. EVA pipelines, composed of deep neural networks (DNNs), typically demand efficient inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-04 Thanh-Tung Nguyen , Lucas Liebe , Nhat-Quang Tau , Yuheng Wu , Jinghan Cheng , Dongman Lee

HyperDimensional Computing (HDC) as a machine learning paradigm is highly interesting for applications involving continuous, semi-supervised learning for long-term monitoring. However, its accuracy is not yet on par with other Machine…

Machine Learning · Computer Science 2023-12-19 William Andrew Simon , Una Pale , Tomas Teijeiro , David Atienza

Edge computing enables data processing closer to the source, significantly reducing latency, an essential requirement for real-time vision-based analytics such as object detection in surveillance and smart city environments. However, these…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-04 Daghash K. Alqahtani , Maria A. Rodriguez , Muhammad Aamir Cheema , Hamid Rezatofighi , Adel N. Toosi

The growing demand of industrial, automotive and service robots presents a challenge to the centralized Cloud Robotics model in terms of privacy, security, latency, bandwidth, and reliability. In this paper, we present a `Fog Robotics'…

Robotics · Computer Science 2019-03-25 Ajay Kumar Tanwani , Nitesh Mor , John Kubiatowicz , Joseph E. Gonzalez , Ken Goldberg

Real-time monitoring of power consumption in cities and micro-grids through the Internet of Things (IoT) can help forecast future demand and optimize grid operations. But moving all consumer-level usage data to the cloud for predictions and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-04 Roopkatha Banerjee , Sampath Koti , Gyanendra Singh , Anirban Chakraborty , Gurunath Gurrala , Bhushan Jagyasi , Yogesh Simmhan

We study the factors affecting training time in multi-device deep learning systems. Given a specification of a convolutional neural network, our goal is to minimize the time to train this model on a cluster of commodity CPUs and GPUs. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-20 Stefan Hadjis , Ce Zhang , Ioannis Mitliagkas , Dan Iter , Christopher Ré

Land use and land cover mapping from Earth Observation (EO) data is a critical tool for sustainable land and resource management. While advanced machine learning and deep learning algorithms excel at analyzing EO imagery data, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Babak Ghassemi , Cassio Fraga-Dantas , Raffaele Gaetano , Dino Ienco , Omid Ghorbanzadeh , Emma Izquierdo-Verdiguier , Francesco Vuolo

Accurate prediction of crop yield before harvest is of great importance for crop logistics, market planning, and food distribution around the world. Yield prediction requires monitoring of phenological and climatic characteristics over…

Machine Learning · Computer Science 2023-02-08 Florian Huber , Artem Yushchenko , Benedikt Stratmann , Volker Steinhage

With the increasing adoption of graph neural networks (GNNs) in the machine learning community, GPUs have become an essential tool to accelerate GNN training. However, training GNNs on very large graphs that do not fit in GPU memory is…

Machine Learning · Computer Science 2021-01-21 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

Today's cloud data centers are often distributed geographically to provide robust data services. But these geo-distributed data centers (GDDCs) have a significant associated environmental impact due to their increasing carbon emissions and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-28 Sirui Qi , Dejan Milojicic , Cullen Bash , Sudeep Pasricha

Deep Learning Training (DLT) is a growing workload in shared GPU/CPU clusters due to its high computational cost and increasing number of jobs. This contributes to significant energy consumption in GPU clusters, further exacerbated by GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-12 Kawsar Haghshenas , Mona Hashemi

Underwater 3D object detection remains one of the most challenging frontiers in computer vision, where traditional approaches struggle with the harsh acoustic environment and scarcity of training data. While deep learning has revolutionized…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 M. Salman Shaukat , Yannik Käckenmeister , Sebastian Bader , Thomas Kirste

Real-time object detection on Unmanned Aerial Vehicles (UAVs) is a challenging issue due to the limited computing resources of edge GPU devices as Internet of Things (IoT) nodes. To solve this problem, in this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Wei Zhou , Xuanlin Min , Rui Hu , Yiwen Long , Huan Luo , JunYi