中文
相关论文

相关论文: Fixed-PSNR Lossy Compression for Scientific Data

200 篇论文

An alternative approach to two-part 'critical compression' is presented. Whereas previous results were based on summing a lossless code at reduced precision with a lossy-compressed error or noise term, the present approach uses a similar…

多媒体 · 计算机科学 2013-01-03 John Scoville

We propose a strategy to compress and store large volumes of scientific data represented on unstructured grids. Approaches utilizing tensor decompositions for data compression have already been proposed. Here, data on a structured grid is…

数值分析 · 数学 2024-09-23 Prashant Rai , Hemanth Kolla , Lewis Cannada , Alex Gorodetsky

Compressed sensing (CS) is a sampling paradigm that allows to simultaneously measure and compress signals that are sparse or compressible in some domain. The choice of a sensing matrix that carries out the measurement has a defining impact…

信息论 · 计算机科学 2017-08-02 Anastasia Lavrenko , Florian Roemer , Giovanni Del Galdo , Reiner Thomae

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

机器学习 · 计算机科学 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

分布式、并行与集群计算 · 计算机科学 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

Image compression and denoising represent fundamental challenges in image processing with many real-world applications. To address practical demands, current solutions can be categorized into two main strategies: 1) sequential method; and…

图像与视频处理 · 电气工程与系统科学 2024-03-27 Shilv Cai , Xiaoguo Liang , Shuning Cao , Luxin Yan , Sheng Zhong , Liqun Chen , Xu Zou

Even though fine-grained pruning techniques achieve a high compression ratio, conventional sparsity representations (such as CSR) associated with irregular sparsity degrade parallelism significantly. Practical pruning methods, thus, usually…

机器学习 · 计算机科学 2022-02-01 Baeseong Park , Se Jung Kwon , Daehwan Oh , Byeongwook Kim , Dongsoo Lee

Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most…

分布式、并行与集群计算 · 计算机科学 2023-12-07 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , Kai Zhao , James Ahrens , Dingwen Tao

High signal to noise ratio (SNR) consistency of model selection criteria in linear regression models has attracted a lot of attention recently. However, most of the existing literature on high SNR consistency deals with model order…

机器学习 · 统计学 2017-03-13 Sreejith Kallummil , Sheetal Kalyani

Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compression with progressive retrieval capability allows users to…

分布式、并行与集群计算 · 计算机科学 2025-04-08 Zhuoxun Yang , Sheng Di , Longtao Zhang , Ruoyu Li , Ximiao Li , Jiajun Huang , Jinyang Liu , Franck Cappello , Kai Zhao

This paper presents a new algorithm for the lossy compression of scalar data defined on 2D or 3D regular grids, with topological control. Certain techniques allow users to control the pointwise error induced by the compression. However, in…

图像与视频处理 · 电气工程与系统科学 2018-02-09 Maxime Soler , Melanie Plainchault , Bruno Conche , Julien Tierny

This paper describes performance bounds for compressed sensing in the presence of Poisson noise when the underlying signal, a vector of Poisson intensities, is sparse or compressible (admits a sparse approximation). The signal-independent…

信息论 · 计算机科学 2009-04-30 Rebecca M. Willett , Maxim Raginsky

Current radio interferometers output multi-petabyte-scale volumes of data per year making the storage, transfer, and processing of this data a sizeable challenge. This challenge is expected to grow with the next-generation telescopes such…

宇宙学与河外天体物理 · 物理学 2024-12-18 J. K. Chege , L. V. E. Koopmans , A. R. Offringa , B. K. Gehlot , S. A. Brackenhoff , E. Ceccotti , S. Ghosh , C. Höfer , F. G. Mertens , M. Mevius , S. Munshi

Designing robust algorithms capable of training accurate neural networks on uncurated datasets from the web has been the subject of much research as it reduces the need for time consuming human labor. The focus of many previous research…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Paul Albert , Eric Arazo , Tarun Krishna , Noel E. O'Connor , Kevin McGuinness

To strike a balance between energy efficiency and data quality control, this paper proposes a sensor censoring scheme for distributed sparse signal recovery via compressive-sensing based wireless sensor networks. In the proposed approach,…

信息论 · 计算机科学 2018-01-16 Jwo-Yuh Wu , Ming-Hsun Yang , Tsang-Yi Wang

Can compression algorithms be employed for recovering signals from their underdetermined set of linear measurements? Addressing this question is the first step towards applying compression algorithms for compressed sensing (CS). In this…

信息论 · 计算机科学 2013-07-11 Shirin Jalali , Arian Maleki

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

The central idea of compressed sensing is to exploit the fact that most signals of interest are sparse in some domain and use this to reduce the number of measurements to encode. However, if the sparsity of the input signal is not precisely…

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one…

分布式、并行与集群计算 · 计算机科学 2022-05-09 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , James Ahrens , Dingwen Tao

The escalating surge in data generation presents formidable challenges to information technology, necessitating advancements in storage, retrieval, and utilization. With the proliferation of artificial intelligence and big data, the "Data…

分布式、并行与集群计算 · 计算机科学 2023-09-19 Xinzhe Chen , Jianjiang Li