Related papers: Persistent storage of non-event data in the CMS da…
The Physics and Data Quality Monitoring (DQM) framework aims at providing a homogeneous monitoring environment across various applications related to data taking at the CMS experiment. In this contribution, the DQM system for the Silicon…
After years of development, the CMS distributed computing system is now in full operation. The LHC continues to set records for instantaneous luminosity, and CMS continues to record data at 300 Hz. Because of the intensity of the beams,…
This paper presents a streamlined framework for real-time processing and analysis of condition data from the CMS experiment Resistive Plate Chambers (RPC). Leveraging data streaming, it uncovers correlations between RPC performance metrics,…
A distributed data warehouse system is one of the actual issues in the field of astroparticle physics. Famous experiments, such as TAIGA, KASCADE-Grande, produce tens of terabytes of data measured by their instruments. It is critical to…
The MIT SuperCloud database management system allows for rapid creation and flexible execution of a variety of the latest scientific databases, including Apache Accumulo and SciDB. It is designed to permit these databases to run on a High…
In order to get ready for physics at the LHC, the CMS experiment has to be set up for data taking. The data have to be well understood before new physics can be investigated. On the other hand, there are standard processes, well known from…
Whether it is for audit or for recovery purposes, data checkpointing is an important problem of distributed database systems. Actually, transactions establish dependence relations on data checkpoints taken by data object managers. So, given…
The CMS collaboration has a long term need to perform large-scale simulation efforts, in which physics events are generated and their manifestations in the CMS detector are simulated. Simulated data are then reconstructed and analyzed by…
The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…
Databases are an essential component of modern computing infrastructures and allow efficient manipulation of inherently structured data. The structure depends on the type and relationships of the individual data elements and on the access…
Over the past 40 years, database management systems (DBMSs) have evolved to provide a sophisticated variety of data management capabilities. At the same time, tools for managing queries over the data have remained relatively primitive. One…
One utilisation of multidimensional databases is the field of On-line Analytical Processing (OLAP). The applications in this area are designed to make the analysis of shared multidimensional information fast [9]. On one hand, speed can be…
In the first LHC running period the CMS-pixel detector had to face various operational challenges and had to adapt to the rapidly changing beam conditions. In order to maximize the physics potential and the quality of the data, online and…
When faults occur in microservice applications -- as they inevitably do -- developers depend on observability data to quickly identify and diagnose the issue. To collect such data, microservices need to be instrumented and the respective…
XDAQ is a generic data acquisition software environment that emerged from a rich set of of use-cases encountered in the CMS experiment. They cover not the deployment for multiple sub-detectors and the operation of different processing and…
In October and November 2008, the CMS collaboration conducted a programme of cosmic ray data taking, which has recorded about 270 million events. The Resistive Plate Chamber system, which is part of the CMS muon detection system, was…
After nearly two decades of design, construction and commissioning, the CMS detector was operated with colliding LHC proton beams for the first time in November 2009. Collision data were recorded at centre-of-mass energies of 0.9 and 2.36…
We present the Monte-Carlo events Data Base (MCDB) project and its development plans. MCDB facilitates communication between authors of Monte-Carlo generators and experimental users. It also provides a convenient book-keeping and an easy…
CMS ECAL physicists must be able to extract physics characteristics from the ECAL construction database for the calibration of sets of detector components. Other applications, such as geometry for simulation and physics event…
Cloud computing is a powerful and popular information technology paradigm that enables data service outsourcing and provides higher-level services with minimal management effort. However, it is still a key challenge to protect data privacy…