English
Related papers

Related papers: Exploring Novel Data Storage Approaches for Large-…

200 papers

HPC environments have traditionally been designed to meet the compute demand of scientific applications and data has only been a second order concern. With science moving toward data-driven discoveries relying more on correlations in data…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-22 Andre Luckow , Pradeep Mantha , Shantenu Jha

Artificial Intelligence (AI) weather prediction (AIWP) models are powerful tools for medium-range forecasts but often lack physical consistency, leading to outputs that violate conservation laws. This study introduces a set of novel…

Atmospheric and Oceanic Physics · Physics 2025-01-30 Yingkai Sha , John S. Schreck , William Chapman , David John Gagne

The accelerating growth of global data generation demands data storage platforms that offer high capacity, long lifespan, and low energy consumption beyond the limits of electronic memory technologies. Optical storage provides an attractive…

With the emergence of large-scale data-intensive high-performance applications, new I/O challenges appear in the efficient management of petabytes of information in High-Performance Computing (HPC) environments. Data management environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Neda Tavakoli , Yong Chen

Numerical weather forecasting using high-resolution physical models often requires extensive computational resources on supercomputers, which diminishes their wide usage in most real-life applications. As a remedy, applying deep learning…

Machine Learning · Computer Science 2023-10-06 Selim Furkan Tekin , Arda Fazla , Suleyman Serdar Kozat

AI requires heavy amounts of storage and compute. As a result, AI developers are regular users of centralised cloud services such as AWS, GCP and Azure, compute environments such as Jupyter and Colab notebooks, and AI Hubs such as…

Networking and Internet Architecture · Computer Science 2022-11-01 Richard Blythman , Mohamed Arshath , Jakub Smékal , Hithesh Shaji , Salvatore Vivona , Tyrone Dunmore

With the exponential growth of data and evolving use cases, petabyte-scale OLAP data platforms are increasingly adopting a model that decouples compute from storage. This shift, evident in organizations like Uber and Meta, introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Chunxu Tang , Bin Fan , Jing Zhao , Chen Liang , Yi Wang , Beinan Wang , Ziyue Qiu , Lu Qiu , Bowen Ding , Shouzhuo Sun , Saiguang Che , Jiaming Mai , Shouwei Chen , Yu Zhu , Jianjian Xie , Yutian , Sun , Yao Li , Yangjun Zhang , Ke Wang , Mingmin Chen

The shift to data-intensive processing from the cloud to the edge has introduced new challenges and expectations for the next generation of intelligent computing systems. As the memory wall continues to grow, modern systems can only meet…

Hardware Architecture · Computer Science 2026-04-16 Denis Hoornaert , Cole Strickler , Manos Athanassoulis , Marco Caccamo , Heechul Yun , Renato Mancuso

In object-oriented or object-relational databases such as multimedia databases or most XML databases, access patterns are not static, i.e., applications do not always access the same objects in the same order repeatedly. However, this has…

Databases · Computer Science 2007-05-23 Zhen He , Jérôme Darmont

The support for aerial users has become the focus of recent 3GPP standardizations of 5G, due to their high maneuverability and flexibility for on-demand deployment. In this paper, probabilistic caching is studied for ultra-dense small-cell…

Signal Processing · Electrical Eng. & Systems 2020-03-31 Fei Song , Jun Li , Ming Ding , Long Shi , Feng Shu , Meixia Tao , Wen Chen , H. Vincent Poor

Non-volatile memory (NVM) technologies suffer from limited write endurance. To address this challenge, we propose Predict and Write (PNW), a K/V-store that uses a clustering-based machine learning approach to extend the lifetime of NVMs.…

Databases · Computer Science 2020-11-06 Saeed Kargar , Heiner Litz , Faisal Nawab

Compared to LHC Run 1 and Run 2, future HEP experiments, e.g., at the HL-LHC, will increase the volume of generated data by an order of magnitude. In order to sustain the expected analysis throughput, ROOT's RNTuple I/O subsystem has been…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-15 Giovanna Lazzari Miotto , Javier Lopez-Gomez

Recently, multiple data-driven models based on machine learning for weather forecasting have emerged. These models are highly competitive in terms of accuracy compared to traditional numerical weather prediction (NWP) systems. In…

Machine Learning · Computer Science 2023-08-10 Wencong Cheng , Yan Yan , Jiangjiang Xia , Qi Liu , Chang Qu , Zhigang Wang

I/O is emerging as a major bottleneck for machine learning training, especially in distributed environments. Indeed, at large scale, I/O takes as much as 85% of training time. Addressing this I/O bottleneck necessitates careful…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-11 Nikoli Dryden , Roman Böhringer , Tal Ben-Nun , Torsten Hoefler

Increasing amounts of data from varied sources, particularly in the fields of machine learning and graph analytics, are causing storage requirements to grow rapidly. A variety of technologies exist for storing and sharing these data,…

Industrial Fog computing deploys various industrial services, such as automatic monitoring/control and imminent failure detection, at the Fog Nodes (FNs) to improve the performance of industrial systems. Much effort has been made in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-21 Lixing Chen , Pan Zhou , Liang Gao , Jie Xu

The complexity-precision trade-off of an object detector is a critical problem for resource constrained vision tasks. Previous works have emphasized detectors implemented with efficient backbones. The impact on this trade-off of proposal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Yunsheng Li , Yinpeng Chen , Xiyang Dai , Dongdong Chen , Mengchen Liu , Pei Yu , Jing Yin , Lu Yuan , Zicheng Liu , Nuno Vasconcelos

Operational forecasting of the ionosphere remains a critical space weather challenge due to sparse observations, complex coupling across geospatial layers, and a growing need for timely, accurate predictions that support Global Navigation…

With the growing demand for latency-critical and computation-intensive Internet of Things (IoT) services, the IoT-oriented network architecture, mobile edge computing (MEC), has emerged as a promising technique to reinforce the computation…

Information Theory · Computer Science 2022-08-09 Jiechen Chen , Hong Xing , Xiaohui Lin , Arumugam Nallanathan , Suzhi Bi

In object-oriented or object-relational databases such as multimedia databases or most XML databases, access patterns are not static, i.e., applications do not always access the same objects in the same order repeatedly. However, this has…

Databases · Computer Science 2007-05-23 Zhen He , Jérôme Darmont