English
Related papers

Related papers: Smart caching in a Data Lake for High Energy Physi…

200 papers

The exponential growth of digital services has positioned data centers among the most energy-intensive infrastructures in the modern economy, raising critical concerns regarding operational costs, carbon emissions, and the sustainable…

Machine Learning · Computer Science 2026-05-05 Abderaouf Bahi , Amel Ourici , Hasan Dincer , Serhat Yuksel , Akila Djebbar

Data from high-energy physics (HEP) experiments are collected with significant financial and human effort and are in many cases unique. At the same time, HEP has no coherent strategy for data preservation and re-use, and many important and…

High Energy Physics - Experiment · Physics 2015-05-27 David M. South

Owing to large industrial energy consumption, industrial production has brought a huge burden to the grid in terms of renewable energy access and power supply. Due to the coupling of multiple energy sources and the uncertainty of renewable…

Systems and Control · Electrical Eng. & Systems 2022-02-14 Dafeng Zhu , Bo Yang , Yuxiang Liu , Zhaojian Wang , Kai Ma , Xinping Guan

The exponential growth of data-intensive applications has placed unprecedented demands on modern storage systems, necessitating dynamic and efficient optimization strategies. Traditional heuristics employed for storage performance…

Operating Systems · Computer Science 2025-08-25 Chiyu Cheng , Chang Zhou , Yang Zhao

In the wake of the highly electrified future ahead of us, the role of energy storage is crucial wherever distributed generation is abundant, such as in microgrid settings. Given the variety of storage options that are becoming more and more…

Machine Learning · Computer Science 2021-03-26 S. Tsianikas , N. Yousefi , J. Zhou , M. Rodgers , D. W. Coit

Data management can be a complex challenge in fields such as bioinformatics and health sciences, which continuously generate extensive heterogeneous datasets. In the context of collaborative global health initiatives, secure storage and…

Software Engineering · Computer Science 2026-05-20 Danilo Silva , Monika Moir , Cheryl Baxter , Tulio de Oliveira , Joicymara Xavier , Marcel Dunaiski

Long-term preservation of data and software of large experiments and detectors in high energy physics is of utmost importance to secure the heritage of (mostly unique) data and to allow advanced physics (re-)analyses at later times.…

High Energy Physics - Experiment · Physics 2011-02-15 Siegfried Bethke

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

Small base stations (SBs) of fifth-generation (5G) cellular networks are envisioned to have storage devices to locally serve requests for reusable and popular contents by \emph{caching} them at the edge of the network, close to the end…

Signal Processing · Electrical Eng. & Systems 2018-12-24 Alireza Sadeghi , Fatemeh Sheikholeslami , Antonio G. Marques , Georgios B. Giannakis

Recent technological advances have greatly improved the performance and features of embedded systems. With the number of just mobile devices now reaching nearly equal to the population of earth, embedded systems have truly become…

Hardware Architecture · Computer Science 2014-01-07 Sparsh Mittal

This is a personal perspective on data sharing in the context of public data releases suitable for generic analysis. These open data can be a powerful tool for expanding the science of high energy physics, but care must be taken in when,…

High Energy Physics - Phenomenology · Physics 2022-08-18 Benjamin Nachman

Machine learning has been applied to several problems in particle physics research, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event…

Computational Physics · Physics 2019-05-17 Kim Albertsson , Piero Altoe , Dustin Anderson , John Anderson , Michael Andrews , Juan Pedro Araque Espinosa , Adam Aurisano , Laurent Basara , Adrian Bevan , Wahid Bhimji , Daniele Bonacorsi , Bjorn Burkle , Paolo Calafiura , Mario Campanelli , Louis Capps , Federico Carminati , Stefano Carrazza , Yi-fan Chen , Taylor Childers , Yann Coadou , Elias Coniavitis , Kyle Cranmer , Claire David , Douglas Davis , Andrea De Simone , Javier Duarte , Martin Erdmann , Jonas Eschle , Amir Farbin , Matthew Feickert , Nuno Filipe Castro , Conor Fitzpatrick , Michele Floris , Alessandra Forti , Jordi Garra-Tico , Jochen Gemmler , Maria Girone , Paul Glaysher , Sergei Gleyzer , Vladimir Gligorov , Tobias Golling , Jonas Graw , Lindsey Gray , Dick Greenwood , Thomas Hacker , John Harvey , Benedikt Hegner , Lukas Heinrich , Ulrich Heintz , Ben Hooberman , Johannes Junggeburth , Michael Kagan , Meghan Kane , Konstantin Kanishchev , Przemysław Karpiński , Zahari Kassabov , Gaurav Kaul , Dorian Kcira , Thomas Keck , Alexei Klimentov , Jim Kowalkowski , Luke Kreczko , Alexander Kurepin , Rob Kutschke , Valentin Kuznetsov , Nicolas Köhler , Igor Lakomov , Kevin Lannon , Mario Lassnig , Antonio Limosani , Gilles Louppe , Aashrita Mangu , Pere Mato , Narain Meenakshi , Helge Meinhard , Dario Menasce , Lorenzo Moneta , Seth Moortgat , Mark Neubauer , Harvey Newman , Sydney Otten , Hans Pabst , Michela Paganini , Manfred Paulini , Gabriel Perdue , Uzziel Perez , Attilio Picazio , Jim Pivarski , Harrison Prosper , Fernanda Psihas , Alexander Radovic , Ryan Reece , Aurelius Rinkevicius , Eduardo Rodrigues , Jamal Rorie , David Rousseau , Aaron Sauers , Steven Schramm , Ariel Schwartzman , Horst Severini , Paul Seyfert , Filip Siroky , Konstantin Skazytkin , Mike Sokoloff , Graeme Stewart , Bob Stienen , Ian Stockdale , Giles Strong , Wei Sun , Savannah Thais , Karen Tomko , Eli Upfal , Emanuele Usai , Andrey Ustyuzhanin , Martin Vala , Justin Vasel , Sofia Vallecorsa , Mauro Verzetti , Xavier Vilasís-Cardona , Jean-Roch Vlimant , Ilija Vukotic , Sean-Jiun Wang , Gordon Watts , Michael Williams , Wenjing Wu , Stefan Wunsch , Kun Yang , Omar Zapata

Data-intensive science is increasingly reliant on real-time processing capabilities and machine learning workflows, in order to filter and analyze the extreme volumes of data being collected. This is especially true at the energy and…

Artificial Intelligence · Computer Science 2021-04-21 Chinmaya Mahesh , Kristin Dona , David W. Miller , Yuxin Chen

The study of plasma physics under conditions of extreme temperatures, densities and electromagnetic field strengths is significant for our understanding of astrophysics, nuclear fusion and fundamental physics. These extreme physical systems…

The area of building energy management has received a significant amount of interest in recent years. This area is concerned with combining advancements in sensor technologies, communications and advanced control algorithms to optimize…

Machine Learning · Computer Science 2019-03-18 Karl Mason , Santiago Grijalva

Beginning from a basic neural-network architecture, we test the potential benefits offered by a range of advanced techniques for machine learning, in particular deep learning, in the context of a typical classification problem encountered…

Data Analysis, Statistics and Probability · Physics 2020-06-03 Giles Chatham Strong

In response to global warming and energy shortages, there has been a significant shift towards integrating renewable energy sources, energy storage systems, and electric vehicles. Deploying electric vehicles within smart grids offers a…

Systems and Control · Electrical Eng. & Systems 2025-02-18 Mehrshad Shokati , Parisa Mohammadi , Atoosa Amirinian

Data analytics stands to benefit from the increasing availability of datasets that are held without their conceptual relationships being explicitly known. When collected, these datasets form a data lake from which, by processes like data…

Databases · Computer Science 2020-11-23 Alex Bogatu , Alvaro A. A. Fernandes , Norman W. Paton , Nikolaos Konstantinou

The next generation of High Energy Physics experiments are expected to generate exabytes of data---two orders of magnitude greater than the current generation. In order to reliably meet peak demands, facilities must either plan to provision…

In recent years, data lakes emerged as away to manage large amounts of heterogeneous data for modern data analytics. One way to prevent data lakes from turning into inoperable data swamps is semantic data management. Some approaches propose…

Databases · Computer Science 2023-10-25 Sayed Hoseini , Johannes Theissen-Lipp , Christoph Quix