English
Related papers

Related papers: Smart caching in a Data Lake for High Energy Physi…

200 papers

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Van-Hai Bui , Srijita Das , Akhtar Hussain , Guilherme Vieira Hollweg , Wencong Su

The development of smart cities and their fast-paced deployment is resulting in the generation of large quantities of data at unprecedented rates. Unfortunately, most of the generated data is wasted without extracting potentially useful…

Networking and Internet Architecture · Computer Science 2018-10-10 Mehdi Mohammadi , Ala Al-Fuqaha

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

Renewable energy brings huge uncertainties to the power system, which challenges the traditional power system operation with limited flexible resources. One promising solution is to introduce dynamic pricing to more consumers, which, if…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Jiaman Wu , Zhiqi Wang , Yang Yu , Chenye Wu

The year of 2020 has witnessed the unprecedented development of 5G networks, along with the widespread deployment of 5G base stations (BSs). Nevertheless, the enormous energy consumption of BSs and the incurred huge energy cost have become…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-16 Hao Yuan , Guoming Tang , Deke Guo , Kui Wu , Xun Shao , Keping Yu , Wei Wei

Systems and machines undergo various failure modes that result in machine health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Since maintenance tasks are…

Machine Learning · Computer Science 2023-07-11 Oluwaseyi Ogunfowora , Homayoun Najjaran

The integration of machine learning into smart grid systems represents a transformative step in enhancing the efficiency, reliability, and sustainability of modern energy networks. By adding advanced data analytics, these systems can better…

Artificial Intelligence · Computer Science 2024-10-22 Abdur Rashid , Parag Biswas , abdullah al masum , MD Abdullah Al Nasim , Kishor Datta Gupta

Energy management decreases energy expenditures and consumption while simultaneously increasing energy efficiency, reducing carbon emissions, and enhancing operational performance. Smart grids are a type of sophisticated energy…

The rapid expansion of cloud computing and data center infrastructure has led to significant energy consumption, posing environmental challenges due to the growing carbon footprint. This research explores energy-aware management strategies…

Networking and Internet Architecture · Computer Science 2025-09-16 Rabab Khan Rongon , Krishna Das

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

Computers and Society · Computer Science 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

Data discovery from data lakes is an essential application in modern data science. While many previous studies focused on improving the efficiency and effectiveness of data discovery, little attention has been paid to the usability of such…

Databases · Computer Science 2025-04-04 Yihao Hu , Jin Wang , Sajjadur Rahman

Data centers play an increasingly critical role in societal digitalization, yet their rapidly growing energy demand poses significant challenges for sustainable operation. To enhance the energy efficiency of geographically distributed data…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Junhong Liu , Lanxin Du , Yujia Li , Rong-Peng Liu , Yunfeng Li , Fei Teng , Francis Yunhe Hou

A number of scientific competitions have been organised in the last few years with the objective of discovering innovative techniques to perform typical High Energy Physics tasks, like event reconstruction, classification and new physics…

Data Analysis, Statistics and Probability · Physics 2020-12-21 David Rousseau , Andrey Ustyuzhanin

Low energy nuclear physics experiments are transitioning towards fully digital data acquisition systems. Realizing the gains in flexibility afforded by these systems relies on equally flexible data reduction techniques. In this paper,…

Data Analysis, Statistics and Probability · Physics 2024-10-01 Caleb Marshall

We develop an energy management system (EMS) for artificial intelligence (AI) data centers with colocated renewable generation. Under a cost-minimizing framework, the EMS of renewable-colocated data center (RCDC) co-optimizes AI workload…

Optimization and Control · Mathematics 2025-09-25 Siying Li , Lang Tong , Timothy D. Mount

Open data is an emerging paradigm to share large and diverse datasets -- primarily from governmental agencies, but also from other organizations -- with the goal to enable the exploitation of the data for societal, academic, and commercial…

Software Engineering · Computer Science 2012-02-09 Holger M. Kienle

This paper presents a capacity-constrained incentive-based demand response approach for residential smart grids. It aims to maintain electricity grid capacity limits and prevent congestion by financially incentivising end users to reduce or…

Machine Learning · Computer Science 2026-02-19 Shafagh Abband Pashaki , Sepehr Maleki , Amir Badiee

In High Energy Physics (HEP), experimentalists generate large volumes of data that, when analyzed, helps us better understand the fundamental particles and their interactions. This data is often captured in many files of small size,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Sunwoo Lee , Kai-yuan Hou , Kewei Wang , Saba Sehrish , Marc Paterno , James Kowalkowski , Quincey Koziol , Robert Ross , Ankit Agrawal , Alok Choudhary , Wei-keng Liao

A data lake is a repository of data with potential for future analysis. However, both discovering what data is in a data lake and exploring related data sets can take significant effort, as a data lake can contain an intimidating amount of…

Databases · Computer Science 2022-06-09 Nour Alhammad , Alex Bogatu , Norman W Paton