English
Related papers

Related papers: Querying Large Physics Data Sets Over an Informati…

200 papers

Over the past few years, we have seen fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. At the same time, the amount of data collected in a wide array of scientific domains…

Machine Learning · Computer Science 2020-03-27 Maithra Raghu , Eric Schmidt

In the domain of high-energy physics (HEP), query languages in general and SQL in particular have found limited acceptance. This is surprising since HEP data analysis matches the SQL model well: the data is fully structured and queried…

Databases · Computer Science 2021-11-02 Dan Graur , Ingo Müller , Mason Proffitt , Ghislain Fourny , Gordon T. Watts , Gustavo Alonso

Experimental High-Energy Physics (HEP), especially the Large Hadron Collider (LHC) programme at the European Organization for Nuclear Research (CERN), is one of the most computationally intensive activities in the world. This demand is set…

Data Analysis, Statistics and Probability · Physics 2021-01-15 Diogo Pires , Pedrame Bargassa , João Seixas , Yasser Omar

High-Energy Physics (HEP) and Gravitational Wave (GW) communities serve different scientific purposes. However, their methodologies might potentially offer mutual enrichment through common software developments. A suite of libraries is…

Instrumentation and Methods for Astrophysics · Physics 2025-03-19 Marco Meyer-Conde , Nobuyuki Kanda , Hirotaka Takahashi , Ken-ichi Oohara , Kazuki Sakai

Grid services are heavily used for handling large distributed computations. They are also very useful to handle heavy data intensive applications where data are distributed in different sites. Most of the data grid services used in such…

Databases · Computer Science 2012-10-16 Tanvir Ahmed , Mohammad Saiedur Rahaman , Mohammad Saidur Rahman , Manzur H. Khan

Gridding operation, which is to map non-uniform data samples onto a uniformly distributedgrid, is one of the key steps in radio astronomical data reduction process. One of the mainbottlenecks of gridding is the poor computing performance,…

Instrumentation and Methods for Astrophysics · Physics 2021-01-14 Hao Wang , Ce Yu , Bo Zhang , Jian Xiao , Qi Luo

At the heart of experimental high energy physics (HEP) is the development of facilities and instrumentation that provide sensitivity to new phenomena. Our understanding of nature at its most fundamental level is advanced through the…

The high energy physics (HEP) community has a long history of dealing with large-scale datasets. To manage such voluminous data, classical machine learning and deep learning techniques have been employed to accelerate physics discovery.…

Machine Learning · Computer Science 2021-01-18 Samuel Yen-Chi Chen , Tzu-Chieh Wei , Chao Zhang , Haiwang Yu , Shinjae Yoo

The integration of machine learning into smart grid systems represents a transformative step in enhancing the efficiency, reliability, and sustainability of modern energy networks. By adding advanced data analytics, these systems can better…

Artificial Intelligence · Computer Science 2024-10-22 Abdur Rashid , Parag Biswas , abdullah al masum , MD Abdullah Al Nasim , Kishor Datta Gupta

As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accordingly. With such large data volumes, next-generation…

High Energy Physics - Experiment · Physics 2022-03-16 Amit Bashyal , Peter Van Gemmeren , Saba Sehrish , Kyle Knoepfel , Suren Byna , Qiao Kang

Each LHC experiment will produce datasets with sizes of order one petabyte per year. All of this data must be stored, processed, transferred, simulated and analyzed, which requires a computing system of a larger scale than ever mounted for…

Instrumentation and Detectors · Physics 2009-10-05 Kenneth Bloom

Data visualization is essential for developing an understanding of a complex system. The power grid is one of the most complex systems in the world and effective power grid research visualization software must 1) be easy to use, 2) support…

Systems and Control · Electrical Eng. & Systems 2025-10-15 Noah Rhodes

Machine learning (ML) is becoming an increasingly important component of cutting-edge physics research, but its computational requirements present significant challenges. In this white paper, we discuss the needs of the physics community…

Data from high-energy physics (HEP) experiments are collected with significant financial and human effort and are mostly unique. At the same time, HEP has no coherent strategy for data preservation and re-use. An inter-experimental Study…

High Energy Physics - Experiment · Physics 2012-08-27 Dphep Study Group

We propose to develop a high-energy heavy-ion experimental database and make it accessible to the scientific community through an on-line interace. This database will be searchable and cross-indexed with relevant publications, including…

Nuclear Theory · Physics 2009-11-11 David A. Brown , Ramona Vogt

In High Energy Physics (HEP), experimentalists generate large volumes of data that, when analyzed, helps us better understand the fundamental particles and their interactions. This data is often captured in many files of small size,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Sunwoo Lee , Kai-yuan Hou , Kewei Wang , Saba Sehrish , Marc Paterno , James Kowalkowski , Quincey Koziol , Robert Ross , Ankit Agrawal , Alok Choudhary , Wei-keng Liao

This PhD thesis explores the potential of quantum computing to address computational challenges in high-energy physics (HEP). As the Standard Model (SM) leaves key questions unanswered and no signs of new physics have emerged since the…

Quantum Physics · Physics 2025-12-02 Jorge J. Martínez de Lejarza

This chapter introduces the state-of-the-art in the emerging area of combining High Performance Computing (HPC) with Big Data Analysis. To understand the new area, the chapter first surveys the existing approaches to integrating HPC with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-01 Yuankun Fu , Fengguang Song