English
Related papers

Related papers: Development of Atlas, a flexible data structure fr…

200 papers

With rapid advances in network hardware, far memory has gained a great deal of traction due to its ability to break the memory capacity wall. Existing far memory systems fall into one of two data paths: one that uses the kernel's paging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-25 Lei Chen , Shi Liu , Chenxi Wang , Haoran Ma , Yifan Qiao , Zhe Wang , Chenggang Wu , Youyou Lu , Xiaobing Feng , Huimin Cui , Shan Lu , Harry Xu

The project CAESAR (Comprehensive spAce wEather Studies for the ASPIS prototype Realization) is aimed to tackle all the relevant aspects of Space Weather (SWE) and realize the prototype of the scientific data centre for Space Weather of the…

Technological advances in high performance computing and maturing physical models allow scientists to simulate weather and climate evolutions with an increasing accuracy. While this improved accuracy allows us to explore complex dynamical…

Human-Computer Interaction · Computer Science 2025-02-04 Simon Schneegans , Lori Neary , Markus Flatken , Andreas Gerndt

Weather forecasting is essential for facilitating diverse socio-economic activity and environmental conservation initiatives. Deep learning techniques are increasingly being explored as complementary approaches to Numerical Weather…

Machine Learning · Computer Science 2025-04-28 Marco Turzi , Siamak Mehrkanoon

Hadoop has become the de facto standard for processing large data in today's cloud environment. The performance of Hadoop in the cloud has a direct impact on many important applications ranging from web analytic, web indexing, image and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-04 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

Machine learning-based weather forecasting models have quickly emerged as a promising methodology for accurate medium-range global weather forecasting. Here, we introduce the Artificial Intelligence Forecasting System (AIFS), a data driven…

While machine learning-based weather prediction (MLWP) has achieved significant advancements, research on assimilating real observations or ensemble forecasts within MLWP models remains limited. We introduce ClimaX-LETKF, the first purely…

Machine Learning · Computer Science 2025-12-17 Akira Takeshima , Kenta Shiraishi , Atsushi Okazaki , Tadashi Tsuyuki , Shunji Kotsuki

In this contribution we report the on-going progresses of the project FATE, an operational automatic forecast system conceived to deliver forecasts of a set of astroclimatic and atmospheric parameters having the aim to support the science…

Instrumentation and Methods for Astrophysics · Physics 2024-09-10 Elena Masciadri , Alessio Turchi , Luca Fini , Alberto Ortolani , Valerio Capecchi , Francesco Pasi , Angel Otarola , Steffen Mieske

The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…

Instrumentation and Methods for Astrophysics · Physics 2022-02-07 Y. G. Grange , V. N. Pandey , X. Espinal , R. Di Maria , A. P. Millar

Accurate weather and climate modeling is critical for both scientific advancement and safeguarding communities against environmental risks. Traditional approaches rely heavily on Numerical Weather Prediction (NWP) models, which simulate…

Machine Learning · Computer Science 2024-09-13 Muhammad Akhtar Munir , Fahad Shahbaz Khan , Salman Khan

This study aims to improve the accuracy of weather predictions by discovering spatial correlations between Earth observations and atmospheric states. Existing numerical weather prediction (NWP) systems predict future atmospheric states at…

Machine Learning · Computer Science 2025-11-11 Hyeon-Ju Jeon , Jeon-Ho Kang , In-Hyuk Kwon , O-Joun Lee

Technology has advanced to the point that it is possible to image the entire sky every night and process the data in real time. The sky is hardly static: many interesting phenomena occur, including variable stationary objects such as stars…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 J. L. Tonry , L. Denneau , A. N. Heinze , B. Stalder , K. W. Smith , S. J. Smartt , C. W. Stubbs , H. J. Weiland , A. Rest

ESCAPE is a free python package and framework for creating applications for simulating and fitting of X-ray and neutron scattering data with current support for specular reflectivity, polarized neutron reflectometry, high resolution X-ray…

Computational Engineering, Finance, and Science · Computer Science 2020-11-11 Denis Korolkov , Stepan Rakhimov

The ATLAS detector at CERN has completed its first full year of recording collisions at 7 TeV, resulting in billions of events and petabytes of data. At these scales, physicists must have the capability to read only the data of interest to…

Data Analysis, Statistics and Probability · Physics 2015-03-13 Peter van Gemmeren , David Malon

Weather forecasting is critical for a range of human activities including transportation, agriculture, industry, as well as the safety of the general public. Machine learning models have the potential to transform the complex weather…

Modern Hybrid Transactional/Analytical Processing (HTAP) systems use an integrated data processing engine that performs analytics on fresh data, which are ingested from a transactional engine. HTAP systems typically consider data freshness…

Databases · Computer Science 2020-04-15 Aunn Raza , Periklis Chrysogelos , Angelos Christos Anadiotis , Anastasia Ailamaki

The Extreme-ultraviolet Stellar Characterization for Atmospheric Physics and Evolution (ESCAPE) mission is an astrophysics Small Explorer employing ultraviolet spectroscopy (EUV: 80 - 825 \AA\ and FUV: 1280 - 1650 \AA) to explore the…

Instrumentation and Methods for Astrophysics · Physics 2022-02-01 K. France , B. Fleming , A. Youngblood , J. Mason , J. Drake , the ESCAPE Science , Instrument Team

Context: The current stellar atmosphere programs still cannot match some fundamental observations of the brightest stars, and with new techniques, such as optical interferometry, providing new data for these stars, additional development of…

Astrophysics · Physics 2009-11-13 John B. Lester , Hilding R. Neilson

The planning and operation of renewable energy, especially wind power, depend crucially on accurate, timely, and high-resolution weather information. Coarse-grid global numerical weather forecasts are typically downscaled to meet these…