English
Related papers

Related papers: Improving Multi-Dimensional Data Formats, Access, …

200 papers

Modern tools for biological research, especially microscopy, have rapidly advanced in recent years, which has led to the generation of increasingly large amounts of data on a regular basis. The result is that scientists desperately need…

Other Quantitative Biology · Quantitative Biology 2021-08-18 Andrey Andreev , Tom Morrell , Kristin Briney , Sandra Gesing , Uri Manor

Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded reanalysis data, diverse geophysical and geochemical observations, and domain-specific text,…

Instrumentation and Methods for Astrophysics · Physics 2026-05-14 Xiangyu Zhao , Bo Liu , Yuehan Zhang , Zelin Song , Wanghan Xu , Feng Liu , Fengxiang Wang , Ben Fei , Fenghua Ling , Wangxu Wei , Wenlong Zhang , Xiao-Ming Wu

Storing data is easy, but finding and using data is not. It is desirable that the data is stored in a structured format, which can be preserved and retrieved in future. Creating Metadata for the data is one way of creating structured data…

Information Theory · Computer Science 2011-01-04 Ranjeet Devarakonda , Giri Palanisamy , Jim Green

This review examined the current advancements in data-driven methods for analyzing flow and transport in porous media, which has various applications in energy, chemical engineering, environmental science, and beyond. Although there has…

Fluid Dynamics · Physics 2024-07-01 Guang Yang , Ran Xu , Yusong Tian , Songyuan Guo , Jingyi Wu , Xu Chu

FITS (Flexible Image Transport System) is a common format for astronomical data storage. It was first standardised in the early 1980s. Even though astronomical data is now processed mostly using software, visual data inspection by a human…

Instrumentation and Methods for Astrophysics · Physics 2019-02-19 Matwey Kornilov , Konstantin Malanchev

The AAO/UKST SuperCOSMOS H$\alpha$ Survey (SHS) was, when completed in 2003, a powerful addition to extant wide-field surveys. The combination of areal coverage, spatial resolution and sensitivity in a narrow imaging band, still marks it…

Astrophysics of Galaxies · Physics 2015-06-15 David J. Frew , Ivan S. Bojicic , Quentin A. Parker , Mark J. Pierce , M. L. P. Gunawardhana , W. A. Reid

The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we…

Despite the successful implementations of physics-informed neural networks in different scientific domains, it has been shown that for complex nonlinear systems, achieving an accurate model requires extensive hyperparameter tuning, network…

Computational Engineering, Finance, and Science · Computer Science 2022-11-30 Milad Ramezankhani , Amir Nazemi , Apurva Narayan , Heinz Voggenreiter , Mehrtash Harandi , Rudolf Seethaler , Abbas S. Milani

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

The correction of exposure-related issues is a pivotal component in enhancing the quality of images, offering substantial implications for various computer vision tasks. Historically, most methodologies have predominantly utilized spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiaoke Shang , Gehui Li , Zhiying Jiang , Shaomin Zhang , Nai Ding , Jinyuan Liu

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom

In the past few decades, the life sciences have experienced an unprecedented accumulation of data, ranging from genomic sequences and proteomic profiles to heavy-content imaging, clinical assays, and commercial biological products for…

Databases · Computer Science 2025-09-22 Rosalia Moreddu

Current HPC platforms do not provide the infrastructure, interfaces and conceptual models to collect, store, analyze, and access such data. Today, applications depend on application and platform specific techniques for collecting telemetry…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-11 Ole Weidner , Malcolm Atkinson , Adam Barker

Solar and Heliosphere physics are areas of remarkable data-driven discoveries. Recent advances in high-cadence, high-resolution multiwavelength observations, growing amounts of data from realistic modeling, and operational needs for…

The rapid evolution of Cyber-Physical Systems (CPS) across various domains like mobility systems, networked control systems, sustainable manufacturing, smart power grids, and the Internet of Things necessitates innovative solutions that…

Optimization and Control · Mathematics 2024-06-25 Andreas A. Malikopoulos

The explosive growth of teletraffic, fueled by the convergence of cyber-physical systems and data-intensive applications, such as the Internet of Things (IoT), autonomous systems, and immersive communications, demands a multidisciplinary…

Artificial Intelligence methods are powerful tools for biological image analysis and processing. High-quality annotated images are key to training and developing new methods, but access to such data is often hindered by the lack of…

Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…

Astrophysics · Physics 2007-05-23 Robert J. Brunner , S. George Djorgovski , Thomas A. Prince , Alex S. Szalay

The rapid growth of solar data is driving changes in the typical workflow and algorithmic approach to solar data analysis. We present recently deployed tools to aid this evolution and layout the path for future development. The majority of…

Instrumentation and Methods for Astrophysics · Physics 2018-07-02 Neal Hurlburt , Sam Freeland , Ryan Timmons