English
Related papers

Related papers: USID and Pycroscopy -- Open frameworks for storing…

200 papers

As the volume of data available from sensor-enabled devices such as vehicles expands, it is increasingly hard for companies to make informed decisions about the cost of capturing, processing, and storing the data from every device. Business…

Performance · Computer Science 2025-04-16 Christopher Bogart , Rajeev Chhajer , Baljit Singh , Tony Fontana , Majd Sakr

PySDM is an open-source Python package for simulating the dynamics of particles undergoing condensational and collisional growth, interacting with a fluid flow and subject to chemical composition changes. It is intended to serve as a…

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth makes it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-28 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , Qian Gong , David Pugmire , Nicholas Thompson , Jong Youl Choi , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." In this manuscript we introduce the SciML software ecosystem as a tool for mixing the information of…

Tracking individual cells in live-cell imaging provides fundamental insights, inevitable for studying causes and consequences of phenotypic heterogeneity, responses to changing environmental conditions or stressors. Microbial cell tracking,…

Quantitative Methods · Quantitative Biology 2025-03-31 Johannes Seiffarth , Katharina Nöh

scida is a Python package for reading and analyzing large scientific data sets with support for various cosmological and galaxy formation simulations out-of-the-box. Data access is provided through a hierarchical dictionary-like data…

Instrumentation and Methods for Astrophysics · Physics 2024-02-29 Chris Byrohl , Dylan Nelson

Unfolding, in the context of high-energy particle physics, refers to the process of removing detector distortions in experimental data. The resulting unfolded measurements are straightforward to use for direct comparisons between…

This article is a sequel to "GPU implementation of a ray-surface intersection algorithm in CUDA" (arXiv:2209.02878) [1]. Its main focus is PyCUDA which represents a Python scripting approach to GPU run-time code generation in the Compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-05 Raymond Leung

We present PyWiFeS, a new Python-based data reduction pipeline for the Wide Field Spectrograph (WiFeS). PyWiFeS consists of a series of core data processing routines built on standard scientific Python packages commonly used in astronomical…

Instrumentation and Methods for Astrophysics · Physics 2013-11-13 Michael J. Childress , Frédéric P. A. Vogt , Jon Nielsen , Robert G. Sharp

Recently, the advent of generative AI technologies has made transformational impacts on our daily lives, yet its application in scientific applications remains in its early stages. Data scarcity is a major, well-known barrier in data-driven…

Machine Learning · Computer Science 2025-01-03 Junhuan Yang , Yuzhou Zhang , Yi Sheng , Youzuo Lin , Lei Yang

Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in…

Piping and Instrumentation Diagrams (P&IDs) constitute the foundational blueprint of a plant, depicting the interconnections among process equipment, instrumentation for process control, and the flow of fluids and control signals. In their…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Soumya Swarup Prusty , Astha Agarwal , Srinivasan Iyenger

A large-scale labeled dataset is a key factor for the success of supervised deep learning in computer vision. However, a limited number of annotated data is very common, especially in ophthalmic image analysis, since manual annotation is…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Zhiyuan Cai , Li Lin , Huaqing He , Xiaoying Tang

Multispectral and hyperspectral images are increasingly popular in different research fields, such as remote sensing, astronomical imaging, or precision agriculture. However, the amount of free data available to perform machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Roberta Iuliana Luca , Alexandra Baicoianu , Ioana Cristina Plajer

This paper aims at providing multi-source remote sensing images registered in geometric space for image fusion. Focusing on the characteristics and differences of multi-source remote sensing images, a feature-based registration algorithm is…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Chenzhong Gao , Wei Li

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

Computers and Society · Computer Science 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

Self-supervised learning (SSL) opens up huge opportunities for medical image analysis that is well known for its lack of annotations. However, aggregating massive (unlabeled) 3D medical images like computerized tomography (CT) remains…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Yutong Xie , Jianpeng Zhang , Yong Xia , Qi Wu

Sonification, or conveying data using non-verbal audio, is a relatively niche but growing approach for presenting data across multiple specialist domains including astronomy, climate science, and beyond. The STRAUSS Python package aims to…

Instrumentation and Methods for Astrophysics · Physics 2025-05-13 James W. Trayford , Samantha Youles , Chris Harrison , Rose Shepherd , Nicolas Bonne

The design of structural & functional materials for specialized applications is being fueled by rapid advancements in materials synthesis, characterization, manufacturing, with sophisticated computational materials modeling frameworks that…

Ptychography has become an indispensable tool for high-resolution, non-destructive imaging using coherent light sources. The processing of ptychographic data critically depends on robust, efficient, and flexible computational reconstruction…