English
Related papers

Related papers: Hadoop on HPC: Integrating Hadoop and Pilot-based …

200 papers

To reproduce eScience, several challenges need to be solved: scientific workflows need to be automated; the involved software versions need to be provided in an unambiguous way; input data needs to be easily accessible; High-Performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Kessy Abarenkov , Anne Fouilloux , Helmut Neukirchen , Abdulrahman Azab

Robust execution environments are important for addressing key challenges in quantum computing, such as application development, portability, and reproducibility, and help unlock the development of modular quantum programs, driving forward…

Quantum Physics · Physics 2025-09-26 Aleksander Wennersteen , Matthieu Moreau , Aurelien Nober , Mourad Beji

Although High Performance Computing (HPC) users understand basic resource requirements such as the number of CPUs and memory limits, internal infrastructural utilization data is exclusively leveraged by cluster operators, who use it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Abel Souza , Kristiaan Pelckmans , Johan Tordsson

Critical goals of scientific computing are to increase scientific rigor, reproducibility, and transparency while keeping up with ever-increasing computational demands. This work presents an integrated framework well-suited for data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-13 Paul Nuyujukian

Genetic Algorithms (GAs) are powerful metaheuristic techniques mostly used in many real-world applications. The sequential execution of GAs requires considerable computational power both in time and resources. Nevertheless, GAs are…

Neural and Evolutionary Computing · Computer Science 2013-12-17 Filomena Ferrucci , M-Tahar Kechadi , Pasquale Salza , Federica Sarro

Conducting a research in an efficient, repetitive, evaluable, but also convenient (in terms of development) way has always been a challenge. To satisfy those requirements in a long term and simultaneously minimize costs of the software…

Software Engineering · Computer Science 2014-03-18 Piotr Jan Dendek , Artur Czeczko , Mateusz Fedoryszak , Adam Kawa , Piotr Wendykier , Lukasz Bolikowski

As a broader set of applications from simulations to data analysis and machine learning require more parallel computational capability, the demand for interactive and urgent high performance computing (HPC) continues to increase. This paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-29 Albert Reuther , Nick Brown , William Arndt , Johannes Blaschke , Christian Boehme , Antony Chazapis , Bjoern Enders , Robert Henschel , Julian Kunkel , Maxime Martinasso

Quantum computing (QC) has gained significant attention over the past two decades due to its potential for speeding up classically demanding tasks. This transition from an academic focus to a thriving commercial sector is reflected in…

Recently, due to rapid development of information and communication technologies, the data are created and consumed in the avalanche way. Distributed computing create preconditions for analyzing and processing such Big Data by distributing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-30 Vladyslav Taran , Oleg Alienin , Sergii Stirenko , A. Rojbi , Yuri Gordienko

Quantum Computing (QC) offers significant potential to enhance scientific discovery in fields such as quantum chemistry, optimization, and artificial intelligence. Yet QC faces challenges due to the noisy intermediate-scale quantum era's…

Let's HPC (www.letshpc.org) is an open-access online platform to supplement conventional classroom oriented High Performance Computing (HPC) and Parallel & Distributed Computing (PDC) education. The web based platform provides online…

Computers and Society · Computer Science 2017-01-24 Akshar Varma , Yashwant Keswani , Yashodhan Bhatnagar , Bhaskar Chaudhury

High Performance Computing (HPC) supercomputers are expected to play an increasingly important role in HEP computing in the coming years. While HPC resources are not necessarily the optimal fit for HEP workflows, computing time at HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-20 Federico Stagni , Andrea Valassi , Vladimir Romanovskiy

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 Mohammad Mohammadi , Timur Bazhirov

As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accordingly. With such large data volumes, next-generation…

High Energy Physics - Experiment · Physics 2022-03-16 Amit Bashyal , Peter Van Gemmeren , Saba Sehrish , Kyle Knoepfel , Suren Byna , Qiao Kang

Deep learning has been postulated as a solution for numerous problems in different branches of science. Given the resource-intensive nature of these models, they often need to be executed on specialized hardware such graphical processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Jose González-Abad , Álvaro López García , Valentin Y. Kozlov

Current trends point to a future where large-scale scientific applications are tightly-coupled HPC/AI hybrids. Hence, we urgently need to invest in creating a seamless, scalable framework where HPC and AI/ML can efficiently work together…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Jens Domke , Mohamed Wahib , Anshu Dubey , Tal Ben-Nun , Erik W. Draeger

High Performance Distributed Computing is essential to boost scientific progress in many areas of science and to efficiently deploy a number of complex scientific applications. These applications have different characteristics that require…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-04 Mariza Ferro , Antonio R. Mury , Laion F. Manfroi , Bruno Schlze

There has been an increasing interest in and growing need for high performance computing (HPC), popularly known as supercomputing, in domains such as textual analytics, business domains analytics, forecasting and natural language processing…

Computers and Society · Computer Science 2021-04-20 Jim Samuel , Margaret Brennan-Tonetta , Yana Samuel , Pradeep Subedi , Jack Smith

Complex workflows play a critical role in accelerating scientific discovery. In many scientific domains, efficient workflow management can lead to faster scientific output and broader user groups. Workflows that can leverage resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Daniel Medeiros , Gabin Schieffer , Jacob Wahlgren , Ivy Peng