English
Related papers

Related papers: A Case Study on Parallel HDF5 Dataset Concatenatio…

200 papers

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

The HEP community is approaching an era were the excellent performances of the particle accelerators in delivering collision at high rate will force the experiments to record a large amount of information. The growing size of the datasets…

Many scientific data sets contain temporal dimensions. These are the data storing information at the same spatial location but different time stamps. Some of the biggest temporal datasets are produced by parallel computing applications such…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-13 Zheng Yuan , William Hendrix , Seung Woo Son , Christoph Federrath , Ankit Agrawal , Wei-keng Liao , Alok Choudhary

Dataset storage, exchange, and access play a critical role in scientific applications. For such purposes netCDF serves as a portable and efficient file format and programming interface, which is popular in numerous scientific application…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jianwei Li , Wei-keng Liao , Alok Choudhary , Robert Ross , Rajeev Thakur , William Gropp , Rob Latham

High-energy physics (HEP) provides ever-growing amount of data. To analyse these, continuously-evolving computational power is required in parallel by extending the storage capacity. Such developments play key roles in the future of this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-10 Gábor Bíró , Gergely Gábor Barnaföldi , Péter Lévai

Experimental Particle Physics has been at the forefront of analyzing the worlds largest datasets for decades. The HEP community was the first to develop suitable software and computing tools for this task. In recent times, new toolkits and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-23 Oliver Gutsche , Matteo Cremonesi , Peter Elmer , Bo Jayatilaka , Jim Kowalkowski , Jim Pivarski , Saba Sehrish , Cristina Mantilla Surez , Alexey Svyatkovskiy , Nhan Tran

Every year the PHENIX collaboration deals with increasing volume of data (now about 1/4 PB/year). Apparently the more data the more questions how to process all the data in most efficient way. In recent past many developments in HEP…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Barbara Jacak , Roy Lacey , Dave Morrison , Irina Sourikova , Andrey Shevel , Qiu Zhiping

Optimizing high-performance power electronic equipment, such as power converters, requires multiscale simulations that incorporate the physics of power semiconductor devices and the dynamics of other circuit components, especially in…

Systems and Control · Electrical Eng. & Systems 2025-01-20 Qingyuan Shi , Chijie Zhuang , Jiapeng Liu , Bo Lin , Xiyu Peng , Dan Wu , Zhicheng Liu , Rong Zeng

The H1 data preservation project was started in 2009 as part of the global data preservation initiative in high-energy physics, DPHEP. In order to retain the full potential for future improvements, the H1 Collaboration aims for level 4 of…

Data Analysis, Statistics and Probability · Physics 2015-06-05 David M. South , Michael Steder

At the heart of experimental high energy physics (HEP) is the development of facilities and instrumentation that provide sensitivity to new phenomena. Our understanding of nature at its most fundamental level is advanced through the…

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to…

High Energy Physics - Experiment · Physics 2025-05-15 Mohammad Atif , Pengfei Ding , Ka Hei Martin Kwok , Charles Leggett

HEP data-processing software must support the disparate physics needs of many experiments. For both collider and neutrino environments, HEP experiments typically use data-processing frameworks to manage the computational complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Christopher D. Jones , Kyle Knoepfel , Paolo Calafiura , Charles Leggett , Vakhtang Tsulaia

Interest in many-core architectures applied to real time selections is growing in High Energy Physics (HEP) experiments. In this paper we describe performance measurements of many-core devices when applied to a typical HEP online task: the…

Instrumentation and Detectors · Physics 2014-11-25 A. Gianelle , S. Amerio , D. Bastieri , M. Corvo , W. Ketchum , T. Liu , A. Lonardo , D. Lucchesi , S. Poprocki , R. Rivera , L. Tosoratto , P. Vicini , P. Wittich

Scientific simulation leveraging high-performance computing (HPC) systems is crucial for modeling complex systems and phenomena in fields such as astrophysics, climate science, and fluid dynamics, generating massive datasets that often…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-03 Wenqi Jia , Ying Huang , Jian Xu , Zhewen Hu , Sian Jin , Jiannan Tian , Yuede Ji , Miao Yin

In High Energy Physics facilities that provide High Performance Computing environments provide an opportunity to efficiently perform the statistical inference required for analysis of data from the Large Hadron Collider, but can pose…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-01 Matthew Feickert , Lukas Heinrich , Giordon Stark , Ben Galewsky

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

Data analysis in high-energy physics (HEP) begins with data reduction, where vast datasets are filtered to extract relevant events. At the Large Hadron Collider (LHC), this process is bottlenecked by slow data transfers between storage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-06 Narangerelt Batsoyol , Jonathan Guiang , Diego Davila , Aashay Arora , Philip Chang , Frank Würthwein , Steven Swanson

Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Y. Morita , H. Sato , Y. Watase , O. Tatebe , S. Sekiguchi , S. Matsuoka , N. Soda , A. Dell'Acqua

In collider-based particle and nuclear physics experiments, data are produced at such extreme rates that only a subset can be recorded for later analysis. Typically, algorithms select individual collision events for preservation and store…

High Energy Physics - Phenomenology · Physics 2022-12-20 Jack H. Collins , Yifeng Huang , Simon Knapen , Benjamin Nachman , Daniel Whiteson

As the particle physics community needs higher and higher precisions in order to test our current model of the subatomic world, larger and larger datasets are necessary. With upgrades scheduled for the detectors of colliding-beam…

Data Analysis, Statistics and Probability · Physics 2025-09-09 Fotis I. Giasemis