English
Related papers

Related papers: Hadoop on HPC: Integrating Hadoop and Pilot-based …

200 papers

HEP data-processing software must support the disparate physics needs of many experiments. For both collider and neutrino environments, HEP experiments typically use data-processing frameworks to manage the computational complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Christopher D. Jones , Kyle Knoepfel , Paolo Calafiura , Charles Leggett , Vakhtang Tsulaia

In the expanding field of Quantum Computing (QC), efficient and seamless integration of QC and high performance computing (HPC) elements (e.g., quantum hardware, classical hardware, and software infrastructure on both sides) plays a crucial…

Quantum Physics · Physics 2023-09-08 Philipp Seitz , Amr Elsharkawy , Xiao-Ting Michelle To , Martin Schulz

In the past couple of decades, the computational abilities of supercomput- ers have increased tremendously. Leadership scale supercomputers now are capable of petaflops. Likewise, the problem size targeted by applications running on such…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-06 Robert Louis Cloud

The increasing demands for computing performance have been a reality regardless of the requirements for smaller and more energy efficient devices. Throughout the years, the strategy adopted by industry was to increase the robustness of a…

Software Engineering · Computer Science 2019-05-07 Hugo Andrade , Ivica Crnkovic

Large, complex, multi-scale, multi-physics simulation codes, running on high performance com-puting (HPC) platforms, have become essential to advancing science and engineering. These codes simulate multi-scale, multi-physics phenomena with…

Computational Engineering, Finance, and Science · Computer Science 2014-10-24 A. Dubey , S. Brandt , R. Brower , M. Giles , P. Hovland , D. Q. Lamb , F. Loffler , B. Norris , B. OShea , C. Rebbi , M. Snir , R. Thakur

Several scientific and industry applications require High Performance Computing (HPC) resources to process and/or simulate complex models. Not long ago, companies, research institutes, and universities used to acquire and maintain…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-21 Kiran Mantripragada , Leonardo P. Tizzei , Alecio P. D. Binotto , Marco A. S. Netto

Agentic systems, in which diverse agents cooperate to tackle challenging problems, are exploding in popularity in the AI community. However, existing agentic frameworks take a relatively narrow view of agents, apply a centralized model, and…

Multiagent Systems · Computer Science 2026-01-30 Alok Kamatar , J. Gregory Pauloski , Yadu Babuji , Ryan Chard , Mansi Sakarvadia , Daniel Babnigg , Kyle Chard , Ian Foster

Continuous integration (CI) has become a ubiquitous practice in modern software development, with major code hosting services offering free automation on popular platforms. CI offers major benefits, as it enables detecting bugs in code…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-03 Todd Gamblin , Daniel S. Katz

The Latin American Giant Observatory (LAGO) project utilizes extensive High-Performance Computing (HPC) resources for complex astroparticle physics simulations, making resource efficiency critical for scientific productivity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Alexander Martinez Mendez , Antonio J. Rubio-Montero , Carlos J. Barrios H. , Hernán Asorey , Rafael Mayo-García , Luis A. Núñez

The escalating complexity of applications and services encourages a shift towards higher-level data processing pipelines that integrate both Cloud-native and HPC steps into the same workflow. Cloud providers and HPC centers typically…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-26 Antony Chazapis , Evangelos Maliaroudakis , Fotis Nikolaidis , Manolis Marazakis , Angelos Bilas

Data-intensive applications are becoming commonplace in all science disciplines. They are comprised of a rich set of sub-domains such as data engineering, deep learning, and machine learning. These applications are built around efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-16 Vibhatha Abeykoon , Supun Kamburugamuve , Chathura Widanage , Niranda Perera , Ahmet Uyar , Thejaka Amila Kanewala , Gregor von Laszewski , Geoffrey Fox

The increasing growth of data volume, and the consequent explosion in demand for computational power, are affecting scientific computing, as shown by the rise of extreme data scientific workflows. As the need for computing power increases,…

Emerging Technologies · Computer Science 2024-04-17 Sandeep Suresh Cranganore , Vincenzo De Maio , Ivona Brandic , Ewa Deelman

Provenance plays a crucial role in scientific workflow execution, for instance by providing data for failure analysis, real-time monitoring, or statistics on resource utilization for right-sizing allocations. The workflows themselves,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Vasilis Bountris , Lauritz Thamsen , Ulf Leser

Managing and preparing complex data for deep learning, a prevalent approach in large-scale data science can be challenging. Data transfer for model training also presents difficulties, impacting scientific fields like genomics, climate…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-09 Arup Kumar Sarker , Aymen Alsaadi , Niranda Perera , Mills Staylor , Gregor von Laszewski , Matteo Turilli , Ozgur Ozan Kilic , Mikhail Titov , Andre Merzky , Shantenu Jha , Geoffrey Fox

High performance computing (HPC) has driven collaborative science discovery for decades. Exascale computing platforms, currently in the design stage, will be deployed around 2022. The next generation of supercomputers is expected to utilize…

Human-Computer Interaction · Computer Science 2015-10-22 Nan-Chen Chen , Sarah S. Poon , Lavanya Ramakrishnan , Cecilia R. Aragon

Environmental science is often fragmented: data is collected using mismatched formats and conventions, and models are misaligned and run in isolation. Cloud computing offers a lot of potential in the way of resolving such issues by…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-08 Yehia Elkhatib , Gordon S. Blair , Bholanathsingh Surajbali

The explosive demand for artificial intelligence (AI) workloads has led to a significant increase in silicon area dedicated to lower-precision computations on recent high-performance computing hardware designs. However, mixed-precision…

Computational Engineering, Finance, and Science · Computer Science 2025-09-09 Aditya Kashi , Hao Lu , Wesley Brewer , David Rogers , Michael Matheson , Mallikarjun Shankar , Feiyi Wang

High-Performance Computing (HPC) systems are the most powerful tools that we currently have to solve complex scientific simulations. Quantum computing (QC) has the potential to enhance HPC systems by accelerating the execution of specific…

In the last years, one of the fields of artificial intelligence that has been investigated the most is nature-inspired computing. The research done on this specific topic showcases the interest that sparks in researchers and practitioners,…

Software Engineering · Computer Science 2023-11-21 Eneko Osaba , Gorka Benguria , Jesus L. Lobo , Josu Diaz-de-Arcaya , Juncal Alonso , Iñaki Etxaniz

Quantum computing promises to provide the next step up in computational power for diverse application areas. In this review, we examine the science behind the quantum hype, and the breakthroughs required to achieve true quantum advantage in…

Quantum Physics · Physics 2025-09-26 R. Au-Yeung , B. Camino , O. Rathore , V. Kendon