English
Related papers

Related papers: Northlight: Declarative and Optimized Analysis of …

200 papers

The increasing energy demands and carbon footprint of large-scale AI require intelligent workload management in globally distributed data centers. Yet progress is limited by the absence of benchmarks that realistically capture the interplay…

As observational datasets become larger and more complex, so too are the questions being asked of these data. Data simulations, i.e., synthetic data with properties (pixelization, noise, PSF, artifacts, etc.) akin to real data, are…

Instrumentation and Methods for Astrophysics · Physics 2019-10-25 Molly S. Peeples , Bjorn Emonts , Mark Kyprianou , Matthew T. Penny , Gregory F. Snyder , Christopher C. Stark , Michael Troxel , Neil T. Zimmerman , John ZuHone

High-resolution gridded climate data are readily available from multiple sources, yet climate research and decision-making increasingly require country and region-specific climate information weighted by socio-economic factors. Moreover,…

Applications · Statistics 2024-12-23 Marco Gortan , Lorenzo Testa , Giorgio Fagiolo , Francesco Lamperti

This document is one of the deliverable reports created for the ESCAPE project. ESCAPE stands for Energy-efficient Scalable Algorithms for Weather Prediction at Exascale. The project develops world-class, extreme-scale computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-20 Willem Deconinck

The amount of collected data in many scientific fields is increasing, all of them requiring a common task: extract knowledge from massive, multi parametric data sets, as rapidly and efficiently possible. This is especially true in astronomy…

The multiscale and turbulent nature of Earth's atmosphere has historically rendered accurate weather modeling a hard problem. Recently, there has been an explosion of interest surrounding data-driven approaches to weather modeling, which in…

Geophysics · Physics 2025-07-08 Seth Minor , Daniel A. Messenger , Vanja Dukic , David M. Bortz

Remote sensing image (RSI) interpretation typically faces challenges due to the scarcity of labeled data, which limits the performance of RSI interpretation tasks. To tackle this challenge, we propose EarthSynth, a diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Jiancheng Pan , Shiye Lei , Yuqian Fu , Jiahao Li , Yanxing Liu , Yuze Sun , Xiao He , Long Peng , Xiaomeng Huang , Bo Zhao

Downscaling is necessary to generate high-resolution observation data to validate the climate model forecast or monitor rainfall at the micro-regional level operationally. Dynamical and statistical downscaling models are often used to get…

Atmospheric and Oceanic Physics · Physics 2023-02-28 Bipin Kumar , Rajib Chattopadhyay , Manmeet Singh , Niraj Chaudhari , Karthik Kodari , Amit Barve

The prediction of solar flares, eruptions, and high energy particle storms is of great societal importance. The data mining approach to forecasting has been shown to be very promising. Benchmark datasets are a key element in the further…

Solar and Stellar Astrophysics · Physics 2018-08-22 Petrus C. Martens , Rafal A. Angryk

Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in…

This paper presents a modern and scalable framework for analyzing Detector Control System (DCS) data from the ATLAS experiment at CERN. The DCS data, stored in an Oracle database via the WinCC OA system, is optimized for transactional…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Luca Canali , Andrea Formica , Michelle Ann Solis

The rapid growth of publicly available textual resources, such as lexicons and domain-specific corpora, presents challenges in efficiently identifying relevant resources. While repositories are emerging, they often lack advanced search and…

Databases · Computer Science 2025-08-01 Anaïs Ollagnier , Aline Menin

Benchmarking anomaly detection approaches for multivariate time series is a challenging task due to a lack of high-quality datasets. Current publicly available datasets are too small, not diverse and feature trivial anomalies, which hinders…

Machine Learning · Computer Science 2025-11-13 Lucas Correia , Jan-Christoph Goos , Thomas Bäck , Anna V. Kononova

Earth system forecasting has traditionally relied on complex physical models that are computationally expensive and require significant domain expertise. In the past decade, the unprecedented increase in spatiotemporal Earth observation…

Machine Learning · Computer Science 2023-12-29 Zhihan Gao , Xingjian Shi , Boran Han , Hao Wang , Xiaoyong Jin , Danielle Maddix , Yi Zhu , Mu Li , Yuyang Wang

Accurate air quality forecasting is crucial for protecting public health and guiding environmental policy, yet it remains challenging due to nonlinear spatiotemporal dynamics, wind-driven transport, and distribution shifts across regions.…

Machine Learning · Computer Science 2026-04-02 Prasanjit Dey , Soumyabrata Dev , Angela Meyer , Bianca Schoen-Phelan

In some complex domains, certain problem-specific decompositions can provide advantages over monolithic designs by enabling comprehension and specification of the design. In this paper we present an intuitive and tractable approach to…

Artificial Intelligence · Computer Science 2026-04-24 Richard Arthur , Virginia DiDomizio , Louis Hoebel

This paper presents the first, 15-PetaFLOP Deep Learning system for solving scientific pattern classification problems on contemporary HPC architectures. We develop supervised convolutional architectures for discriminating signals in…

This paper overviews two interdependent issues important for mining remote sensing data (e.g. images) obtained from atmospheric monitoring missions. The first issue relates the building new public datasets and benchmarks, which are hot…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Chaabane Djeraba , Jérôme Riedi

Detecting salient parts in text using natural language processing has been widely used to mitigate the effects of information overflow. Nevertheless, most of the datasets available for this task are derived mainly from academic…

Computation and Language · Computer Science 2024-03-26 Andrés García-Silva , Cristian Berrío , José Manuel Gómez-Pérez

The current role of data-driven science is constantly increasing its importance within Astrophysics, due to the huge amount of multi-wavelength data collected every day, characterized by complex and high-volume information requiring…

Instrumentation and Methods for Astrophysics · Physics 2021-04-15 Massimo Brescia , Stefano Cavuoti , Oleksandra Razim , Valeria Amaro , Giuseppe Riccio , Giuseppe Longo