English
Related papers

Related papers: A Parallel Data Compression Framework for Large Sc…

200 papers

We investigate the feasibility of high performance scientific computation using cloud computers as an alternative to traditional computational tools. The availability of these large, virtualized pools of compute resources raises the…

Materials Science · Physics 2009-01-05 J. J. Rehr , J. P. Gardner , M. Prange , L. Svec , F. Vila

Data is the driving force of machine learning, with the amount and quality of training data often being more important for the performance of a system than architecture and training details. But collecting, processing and annotating real…

Edge computing enables data processing and storage closer to where the data are created. Given the largely distributed compute environment and the significantly dispersed data distribution, there are increasing demands of data sharing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Zheng Li , Diego Seco , José Fuentes-Sepúlveda

Developing collaborative research platforms for quantum bit control is crucial for driving innovation in the field, as they enable the exchange of ideas, data, and implementation to achieve more impactful outcomes. Furthermore, considering…

Quantum Physics · Physics 2024-10-25 Devanshu Brahmbhatt , Yilun Xu , Neel Vora , Larry Chen , Neelay Fruitwala , Gang Huang , Qing Ji , Phuc Nguyen

Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of…

Data Structures and Algorithms · Computer Science 2022-03-01 Matthieu Martel

Modern scientific simulations generate massive volumes of data, creating significant challenges for I/O and storage systems. Error-bounded lossy compression (EBLC) offers a solution by reducing data set sizes while preserving data quality…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-16 Grant Wilkins , Sheng Di , Jon C. Calhoun , Robert Underwood , Franck Cappello

It was estimated that the world produced $59 ZB$ ($5.9 \times 10^{13} GB$) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new…

Machine Learning · Computer Science 2021-11-02 Shifeng Zhang , Ning Kang , Tom Ryder , Zhenguo Li

The "IMP Science Gateway Portal" (http://scigate.imp.kiev.ua) for complex workflow management and integration of distributed computing resources (like clusters, service grids, desktop grids, clouds) is presented. It is created on the basis…

Computational Engineering, Finance, and Science · Computer Science 2014-04-23 Yuri Gordienko , Lev Bekenov , Olexandr Gatsenko , Elena Zasimchuk , Valentin Tatarenko

We investigate the capabilities of cloud computing for large-scale,tightly-coupled simulations of biological fluids in complex geometries, traditionally performed in supercomputing centers. We demonstrate scalable and efficient simulations…

Recently, immersive media and autonomous driving applications have significantly advanced through 3D Gaussian Splatting (3DGS), which offers high-fidelity rendering and computational efficiency. Despite these advantages, 3DGS as a…

Graphics · Computer Science 2025-05-27 Kangli Wang , Shihao Li , Qianxi Yi , Wei Gao

A computational fluid dynamics (CFD) simulation framework for fluid-flow prediction is developed on the Tensor Processing Unit (TPU) platform. The TPU architecture is featured with accelerated dense matrix multiplication, large high…

Computational Physics · Physics 2022-03-02 Qing Wang , Matthias Ihme , Yi-Fan Chen , John Anderson

The simulation and parameter optimization of coupled ocean circulation and ecosystem models in three space dimensions is one of the most challenging tasks in numerical climate research. Here we present a scientific toolkit that aims at…

Atmospheric and Oceanic Physics · Physics 2014-10-02 Jaroslaw Piwonski , Thomas Slawig

Large-scale 3D point clouds (LS3DPC) obtained by LiDAR scanners require huge storage space and transmission bandwidth due to a large amount of data. The existing methods of LS3DPC compression separately perform rule-based point sampling and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jae-Young Yim , Jae-Young Sim

Designing efficient cooling systems for integrated circuits (ICs) relies on a deep understanding of the electro-thermal properties of transistors. To shed light on this issue in currently fabricated FinFETs, a quantum mechanical solver…

Computational Engineering, Finance, and Science · Computer Science 2019-12-20 Alexandros Nikolaos Ziogas , Tal Ben-Nun , Guillermo Indalecio Fernández , Timo Schneider , Mathieu Luisier , Torsten Hoefler

Simulating liquid water to an accuracy that matches its wealth of available experimental data requires both precise electronic structure methods and reliable sampling of nuclear (quantum) motion. This is challenging because applying the…

Edge computing has become critical for enabling latency-sensitive applications, especially when paired with cloud resources to form cloud-assisted edge clusters. However, efficient resource management remains challenging due to edge nodes'…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-22 Amirhossein Pashaeehir , Sina Shariati , Shayan Shafaghi , Manni Moghimi , Mahmoud Momtazpour

With applications ranging from metabolomics to histopathology, quantitative phase microscopy (QPM) is a powerful label-free imaging modality. Despite significant advances in fast multiplexed imaging sensors and deep-learning-based inverse…

Particle filters are a group of algorithms to solve inverse problems through statistical Bayesian methods when the model does not comply with the linear and Gaussian hypothesis. Particle filters are used in domains like data assimilation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Sebastian Friedemann , Kai Keller , Yen-Sen Lu , Bruno Raffin , Leonardo Bautista Gomez

Data management is becoming increasingly important in dealing with the large amounts of data produced by large-scale scientific simulations and instruments. Existing multilevel compression algorithms offer a promising way to manage…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-12 Xin Liang , Ben Whitney , Jieyang Chen , Lipeng Wan , Qing Liu , Dingwen Tao , James Kress , Dave Pugmire , Matthew Wolf , Norbert Podhorszki , Scott Klasky

Several data compressors have been proposed in distributed optimization frameworks of network systems to reduce communication overhead in large-scale applications. In this paper, we demonstrate that effective information compression may…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Zihao Ren , Lei Wang , Xinlei Yi , Xi Wang , Deming Yuan , Tao Yang , Zhengguang Wu , Guodong Shi