Related papers: Data Preservation in High Energy Physics - why, ho…
Accelerators and detectors are expensive, both in terms of money and human effort. It is thus important to invest effort in performing a good statistical analysis of the data, in order to extract the best information from it. This series of…
An increasing amount of information today is generated, exchanged, and stored digitally. This also includes long-lived and highly sensitive information (e.g., electronic health records, governmental documents) whose integrity and…
Over the past decades and even centuries, the astronomical community has accumulated a signif-icant heritage of recorded observations of a great many astronomical objects. Those records con-tain irreplaceable information about long-term…
Gyrocenter dynamics of charged particles plays a fundamental role in plasma physics. In particular, accuracy and conservation of energy are important features for correctly performing long-time simulations. For this purpose, we here propose…
A trend for future high energy physics experiments is an increase in the data bandwidth produced from the detectors. Datasets of the Petabyte scale have already become the norm, and the requirements of future experiments -- greater in size,…
Bringing a high-dimensional dataset into science-ready shape is a formidable challenge that often necessitates data compression. Compression has accordingly become a key consideration for contemporary cosmology, affecting public data…
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones.…
The expected performance of the ATLAS and CMS detectors at the Large Hadron Collider (LHC) in QCD and top quark measurements is discussed, with a focus on the early data taking phase. Such processes are amongst the primary backgrounds in…
To produce the best physics results, high energy physics experiments require access to calibration and other non-event data during event data processing. These conditions data are typically stored in databases that provide versioning…
How can an author store digital information so that it will be reliably useful, even years later when he is no longer available to answer questions? Methods that might work are not good enough; what is preserved today should be reliably…
The Large Hadron Collider (LHC), which collides protons at an energy of 14 TeV, produces hundreds of exabytes of data per year, making it one of the largest sources of data in the world today. At present it is not possible to even transfer…
The Large Hadron Collider will provide an unprecedented quantity of collision data right from the start-up. The challenge for the LHC experiments is the quick use of these data for the final commissioning of the detectors, including…
In a recent paper, PNAS, 118, e1921529118 (2021), it was argued that while the standard definition of conservation laws in quantum mechanics, which is of a statistical character, is perfectly valid, it misses essential features of nature…
This document introduces basics in data preparation, feature selection and learning basics for high energy physics tasks. The emphasis is on feature selection by principal component analysis, information gain and significance measures for…
For the successful development of the astrophysics and, accordingly, for obtaining more complete knowledge of the Universe, it is extremely important to combine and comprehensively analyze information of various types (e.g., about charged…
Scientific computing workflows generate enormous distributed data that is short-lived, yet critical for job completion time. This class of data is called intermediate data. A common way to achieve high data availability is to replicate…
Long-lived particles have significant enough lifetimes as to, when produced in collisions, leave a distinct signature in the detectors. Driven by increasingly higher energies, trigger and reconstruction algorithms at particle colliders are…
This report exists to provide high-level guidance for the strategic and engineering development of Data Management and Preservation plans for 'Big Science' data. Although the report's nominal audience is therefore rather narrow, we intend…
A brief summary of some highlights in the study of high energy astrophysical sources over the past decade is presented. It is argued that the great progress that has been made derives largely from the application of new technology to…
Top quark physics measurements performed using data from the ATLAS detector at the LHC rely on efficient reconstruction and precise calibration of leptons, jets and missing transverse energy. A review of the techniques used to reconstruct…