中文
相关论文

相关论文: Fixed-PSNR Lossy Compression for Scientific Data

200 篇论文

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

统计力学 · 物理学 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

Error-bounded lossy compression has been widely adopted in many scientific domains because it can address the challenges in storing, transferring, and analyzing unprecedented amounts of scientific data. Although error-bounded lossy…

数据库 · 计算机科学 2025-07-15 Jinyang Liu , Pu Jiao , Kai Zhao , Xin Liang , Sheng Di , Franck Cappello

We propose to reduce the original well-posed problem of compressive sensing to weighted-MAX-SAT. Compressive sensing is a novel randomized data acquisition approach that linearly samples sparse or compressible signals at a rate much below…

信息论 · 计算机科学 2019-05-28 Ramin Ayanzadeh , Milton Halem , Tim Finin

This paper describes performance bounds for compressed sensing (CS) where the underlying sparse or compressible (sparsely approximable) signal is a vector of nonnegative intensities whose measurements are corrupted by Poisson noise. In this…

信息论 · 计算机科学 2015-05-14 Maxim Raginsky , Rebecca M. Willett , Zachary T. Harmany , Roummel F. Marcia

We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algorithms…

机器学习 · 统计学 2017-03-02 Lucas Theis , Wenzhe Shi , Andrew Cunningham , Ferenc Huszár

Sequential data is being generated at an unprecedented pace in various forms, including text and genomic data. This creates the need for efficient compression mechanisms to enable better storage, transmission and processing of such data. To…

计算与语言 · 计算机科学 2018-11-21 Mohit Goyal , Kedar Tatwawadi , Shubham Chandak , Idoia Ochoa

Compressed sensing is a technique for recovering an unknown sparse signal from a small number of linear measurements. When the measurement matrix is random, the number of measurements required for perfect recovery exhibits a phase…

最优化与控制 · 数学 2016-12-30 Mateo Díaz , Mauricio Junca , Felipe Rincón , Mauricio Velasco

Deep neural networks (DNNs) frequently contain far more weights, represented at a higher precision, than are required for the specific task which they are trained to perform. Consequently, they can often be compressed using techniques such…

机器学习 · 计算机科学 2020-12-03 Vinu Joseph , Saurav Muralidharan , Animesh Garg , Michael Garland , Ganesh Gopalakrishnan

Many scientific codes and instruments generate large amounts of floating-point data at high rates that must be compressed before they can be stored. Typically, only lossy compression algorithms deliver high-enough compression ratios.…

分布式、并行与集群计算 · 计算机科学 2026-03-31 Alex Fallin , Nathaniel Gorski , Tripti Agarwal , Bei Wang , Ganesh Gopalakrishnan , Martin Burtscher

The expected data rate produced by the Low Frequency Instrument (LFI) planned to fly on the ESA Planck mission in 2007, is over a factor 8 larger than the bandwidth allowed by the spacecraft transmission system to download the LFI data. We…

天体物理学 · 物理学 2009-10-31 M. Maris , D. Maino , C. Burigana , F. Pasian

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such…

We study the problem of multi-compression and reconstructing a stochastic signal observed by several independent sensors (or compressors) that transmit compressed information to a fusion center. { The key aspect of this problem is to find…

信息论 · 计算机科学 2021-11-08 Pablo Soto-Quiros , Anatoli Torokhti , Stanley J. Miklavcic

Optimal sensor placement is a central challenge in the design, prediction, estimation, and control of high-dimensional systems. High-dimensional states can often leverage a latent low-dimensional representation, and this inherent…

最优化与控制 · 数学 2020-05-18 Krithika Manohar , Bingni W. Brunton , J. Nathan Kutz , Steven L. Brunton

We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the…

信息论 · 计算机科学 2024-10-28 Alex Marchioni , Andriy Enttsel , Mauro Mangia , Riccardo Rovatti , Gianluca Setti

Data-parallel SGD is the de facto algorithm for distributed optimization, especially for large scale machine learning. Despite its merits, communication bottleneck is one of its persistent issues. Most compression schemes to alleviate this…

神经与进化计算 · 计算机科学 2024-02-07 Ashok Vardhan Makkuva , Marco Bondaschi , Thijs Vogels , Martin Jaggi , Hyeji Kim , Michael C. Gastpar

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

信息论 · 计算机科学 2012-06-26 Galen Reeves , Michael Gastpar

Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices. A common approach to conserve bandwidth involves resizing or compressing data prior to…

机器学习 · 计算机科学 2021-08-13 Michael Kuchnik , George Amvrosiadis , Virginia Smith

It is well known that lossless compression of a discrete memoryless source with near-uniform encoder output is possible at a rate above its entropy if and only if the encoder is randomized. This work focuses on deriving conditions for…

信息论 · 计算机科学 2016-07-12 Badri N Vellambi , Joerg Kliewer , Matthieu Bloch

Compressed sensing in MRI enables high subsampling factors while maintaining diagnostic image quality. This technique enables shortened scan durations and/or improved image resolution. Further, compressed sensing can increase the diagnostic…

图像与视频处理 · 电气工程与系统科学 2019-03-20 Joseph Y. Cheng , Feiyu Chen , Christopher Sandino , Morteza Mardani , John M. Pauly , Shreyas S. Vasanawala

High-energy, large-scale particle colliders in nuclear and high-energy physics generate data at extraordinary rates, reaching up to $1$ terabyte and several petabytes per second, respectively. The development of real-time, high-throughput…

人工智能 · 计算机科学 2024-12-03 Xihaier Luo , Samuel Lurvey , Yi Huang , Yihui Ren , Jin Huang , Byung-Jun Yoon