English
Related papers

Related papers: A General Framework for Progressive Data Compressi…

200 papers

To address the common problem of high dimensionality in tensor regressions, we introduce a generalized tensor random projection method that embeds high-dimensional tensor-valued covariates into low-dimensional subspaces with minimal loss of…

Methodology · Statistics 2025-10-03 Roberto Casarin , Radu Craiu , Qing Wang

Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-22 Sian Jin , Jesus Pulido , Pascal Grosset , Jiannan Tian , Dingwen Tao , James Ahrens

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing…

Machine Learning · Computer Science 2024-05-24 Matthias Chung , Rick Archibald , Paul Atzberger , Jack Michael Solomon

This work studies formal utility and privacy guarantees for a simple multiplicative database transformation, where the data are compressed by a random linear or affine transformation, reducing the number of data records substantially, while…

Machine Learning · Statistics 2009-01-13 Shuheng Zhou , Katrina Ligett , Larry Wasserman

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello

Lossy compression algorithms are typically designed to achieve the lowest possible distortion at a given bit rate. However, recent studies show that pursuing high perceptual quality would lead to increase of the lowest achievable distortion…

Information Theory · Computer Science 2021-06-15 Zeyu Yan , Fei Wen , Rendong Ying , Chao Ma , Peilin Liu

Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently. Nevertheless, DNNs still lack excellent run-time dynamic inference capability to enable users trade-off accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Li Yang , Zhezhi He , Yu Cao , Deliang Fan

LiDAR point clouds are fundamental to various applications, yet the extreme sparsity of high-precision geometric details hinders efficient context modeling, thereby limiting the compression speed and performance of existing methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Pengpeng Yu , Haoran Li , Runqing Jiang , Dingquan Li , Jing Wang , Liang Lin , Yulan Guo

The presence of smart objects is increasingly widespread and their ecosystem, also known as Internet of Things, is relevant in many different application scenarios. The huge amount of temporally annotated data produced by these smart…

Databases · Computer Science 2022-09-21 Giacomo Chiarot , Claudio Silvestri

The excellent performance of deep neural networks is usually accompanied by a large number of parameters and computations, which have limited their usage on the resource-limited edge devices. To address this issue, abundant methods such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Muzhou Yu , Linfeng Zhang , Kaisheng Ma

Forward regression is a crucial methodology for automatically identifying important predictors from a large pool of potential covariates. In contexts with moderate predictor correlation, forward selection techniques can achieve screening…

Methodology · Statistics 2024-08-23 Xuejun Jiang , Yue Ma , Haofeng Wang

This paper addresses the challenges of storage and communication costs for large-scale datasets in resource-constrained edge devices by proposing a novel dataset quantization approach to reduce intra-sample redundancy. Unlike traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chenyue Yu , Jianyu Yu

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

In recent years, as data and problem sizes have increased, distributed learning has become an essential tool for training high-performance models. However, the communication bottleneck, especially for high-dimensional data, is a challenge.…

Optimization and Control · Mathematics 2025-04-28 Dmitry Bylinkin , Aleksandr Beznosikov

We introduce a conceptually simple and scalable framework for continual learning domains where tasks are learned sequentially. Our method is constant in the number of parameters and is designed to preserve performance on previously…

Neural network compression methods have enabled deploying large models on emerging edge devices with little cost, by adapting already-trained models to the constraints of these devices. The rapid development of AI-capable edge devices with…

Machine Learning · Computer Science 2019-12-20 Soroosh Khoram , Jing Li

Modern computer vision requires processing large amounts of data, both while training the model and/or during inference, once the model is deployed. Scenarios where images are captured and processed in physically separated locations are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sudeep Katakol , Basem Elbarashy , Luis Herranz , Joost van de Weijer , Antonio M. Lopez

Diffusion probabilistic models have achieved mainstream success in many generative modeling tasks, from image generation to inverse problem solving. A distinct feature of these models is that they correspond to deep hierarchical latent…

Machine Learning · Computer Science 2024-12-30 Yibo Yang , Justus C. Will , Stephan Mandt