English
Related papers

Related papers: A Serverless Engine for High Energy Physics Distri…

200 papers

Interest in many-core architectures applied to real time selections is growing in High Energy Physics (HEP) experiments. In this paper we describe performance measurements of many-core devices when applied to a typical HEP online task: the…

Instrumentation and Detectors · Physics 2014-11-25 A. Gianelle , S. Amerio , D. Bastieri , M. Corvo , W. Ketchum , T. Liu , A. Lonardo , D. Lucchesi , S. Poprocki , R. Rivera , L. Tosoratto , P. Vicini , P. Wittich

With the growing complexity of big data workloads that require abundant data and computation, data centers consume a tremendous amount of power daily. In an effort to minimize data center power consumption, several studies developed power…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-22 Nigel Bernard , Hoa Nguyen , Aman Chandan , Savyasachi Jagdeeshan , Namdev Prabhugaonkar , Rutuja Shah , Hyeran Jeon

The increasing use of hardware processing accelerators tailored for specific applications, such as the Vision Processing Unit (VPU) for image recognition, further increases developers' configuration, development, and management overhead.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-08 Sebastian Werner , Trever Schirmer

Today's world of scientific software for High Energy Physics (HEP) is powered by x86 code, while the future will be much more reliant on accelerators like GPUs and FPGAs. The portable parallelization strategies (PPS) project of the High…

High-energy physics (HEP) experiments have developed millions of lines of code over decades that are optimized to run on traditional x86 CPU systems. However, we are seeing a rapidly increasing fraction of floating point computing power in…

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

At the Large Hadron Collider, the vast amount of data from experiments demands not only sophisticated algorithms but also substantial computational power for efficient processing. This paper introduces hardware acceleration as an essential…

High Energy Physics - Experiment · Physics 2025-01-15 Pelayo Leguina López , Santiago Folgueras

At the CHEP03 conference we launched the Physics Analysis eXpert (PAX), a C++ toolkit released for the use in advanced high energy physics (HEP) analyses. This toolkit allows to define a level of abstraction beyond detector reconstruction…

Data Analysis, Statistics and Probability · Physics 2009-11-11 Steffen Kappler , Martin Erdmann , Ulrich Felzmann , Dominic Hirschbuehl , Matthias Kirsch , Guenter Quast , Alexander Schmidt , Joanna Weng

The scale of scientific High Performance Computing (HPC) and High Throughput Computing (HTC) has increased significantly in recent years, and is becoming sensitive to total energy use and cost. Energy-efficiency has thus become an important…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-14 David Abdurachmanov , Peter Elmer , Giulio Eulisse , Robert Knight , Tapio Niemi , Jukka K. Nurminen , Filip Nyback , Goncalo Pestana , Zhonghong Ou , Kashif Khan

The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide.…

Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and…

Databases · Computer Science 2021-09-08 Gordon Watts

Experiments on the Large Hadron Collider at CERN represent our furthest excursion yet along the energy frontier of particle physics. The goal of probing physical processes at the TeV energy scale puts strict requirements on the performance…

High Energy Physics - Experiment · Physics 2017-08-23 Jason Nielsen

Quantum computing offers a new paradigm for advancing high-energy physics research by enabling novel methods for representing and reasoning about fundamental quantum mechanical phenomena. Realizing these ideals will require the development…

The field of high energy physics (HEP) has seen a marked increase in the use of machine learning (ML) techniques in recent years. The proliferation of applications has revolutionised many aspects of the data processing pipeline at collider…

Particle physics has an ambitious and broad global experimental programme for the coming decades. Large investments in building new facilities are already underway or under consideration. Scaling the present processing power and data…

Adapting the cloud for high-performance computing (HPC) is a challenging task, as software for HPC applications hinges on fast network connections and is sensitive to hardware failures. Using cloud infrastructure to recreate conventional…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Philipp A. Witte , Mathias Louboutin , Henryk Modzelewski , Charles Jones , James Selvage , Felix J. Herrmann

Historically, high energy physics computing has been performed on large purpose-built computing systems. These began as single-site compute facilities, but have evolved into the distributed computing grids used today. Recently, there has…

Distributed systems that manage and process graph-structured data internally solve a graph partitioning problem to minimize their communication overhead and query run-time. Besides computational complexity -- optimal graph partitioning is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-24 Ruben Mayer , Hans-Arno Jacobsen

New facilities of the 2020s, such as the High Luminosity Large Hadron Collider (HL-LHC), will be relevant through at least the 2030s. This means that their software efforts and those that are used to analyze their data need to consider…

Training and deploying deep learning models in real-world applications require processing large amounts of data. This is a challenging task when the amount of data grows to a hundred terabytes, or even, petabyte-scale. We introduce a hybrid…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-17 Davit Buniatyan