English
Related papers

Related papers: Inference-Sufficient Representations for High-Thro…

200 papers

Implicit Neural Representations (INRs) are increasingly recognized as a versatile data modality for representing discretized signals, offering benefits such as infinite query resolution and reduced storage requirements. Existing signal…

Machine Learning · Computer Science 2025-03-26 Dhananjaya Jayasundara , Sudarshan Rajagopalan , Yasiru Ranasinghe , Trac D. Tran , Vishal M. Patel

With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yimin Zhou , Yichong Xia , Bin Chen , Mingyao Hong , Jiawei Li , Zhi Wang , Yaowei Wang

Exascale computing promises quantities of data too large to efficiently store and transfer across networks in order to be able to analyze and visualize the results. We investigate Compressive Sensing (CS) as a way to reduce the size of the…

Information Theory · Computer Science 2015-08-27 Maher Salloum , Nathan Fabian , David M. Hensinger , Jeremy A. Templeton

In this article, a novel fast randomized subspace system identification method for estimating combined deterministic-stochastic LTI state-space models, is proposed. The algorithm is especially well-suited to identify high-order and…

Systems and Control · Electrical Eng. & Systems 2023-12-12 Vatsal Kedia , Debraj Chakraborty

Lossy compression plays a growing role in scientific simulations where the cost of storing their output data can span terabytes. Using error bounded lossy compression reduces the amount of storage for each simulation; however, there is no…

Applications · Statistics 2021-11-30 David Krasowska , Julie Bessac , Robert Underwood , Jon C. Calhoun , Sheng Di , Franck Cappello

Diffuse optical imaging (DOI) offers valuable insights into scattering mediums, but the quest for high-resolution imaging often requires dense sampling strategies, leading to higher imaging errors and lengthy acquisition times. This work…

Optics · Physics 2025-04-07 Ben Wiesel , Shlomi Arnon

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Markus Stroot , Stefan Seiler , Philipp Lutat , Andreas Ulbig

Cryogenic electron microscopy (Cryo-EM) has become an essential tool for capturing high-resolution biological structures. Despite its advantage in visualizations, the large storage size of Cryo-EM data file poses significant challenges for…

Machine Learning · Computer Science 2025-12-16 Chunyu Zou

The rapid proliferation of Large Language Models has created an environmental paradox: the very technology that could help solve climate challenges is itself becoming a significant contributor to global carbon emissions. We test whether…

Computation and Language · Computer Science 2026-03-26 Warren Johnson

Light-field fluorescence microscopy (LFM) is a powerful elegant compact method for long-term high-speed imaging of complex biological systems, such as neuron activities and rapid movements of organelles. LFM experiments typically generate…

Image and Video Processing · Electrical Eng. & Systems 2023-10-17 Changqing Su , Zihan Lin , You Zhou , Shuai Wang , Yuhan Gao , Chenggang Yan , Bo Xiong

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

We begin by presenting a simple lossy compressor operating at near-zero rate: The encoder merely describes the indices of the few maximal source components, while the decoder's reconstruction is a natural estimate of the source components…

Information Theory · Computer Science 2016-03-09 Albert No , Tsachy Weissman

Industry-scale recommender systems face a core challenge: representing entities with high cardinality, such as users or items, using dense embeddings that must be accessible during both training and inference. However, as embedding sizes…

Information Retrieval · Computer Science 2025-05-19 Petr Kasalický , Martin Spišák , Vojtěch Vančura , Daniel Bohuněk , Rodrigo Alves , Pavel Kordík

Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-22 Sian Jin , Jesus Pulido , Pascal Grosset , Jiannan Tian , Dingwen Tao , James Ahrens

Data selection is crucial for optimizing language model (LM) performance on specific tasks, yet most existing methods fail to effectively consider the target task distribution. Current approaches either ignore task-specific requirements…

Machine Learning · Computer Science 2025-04-15 Elyas Obbad , Iddah Mlauzi , Brando Miranda , Rylan Schaeffer , Kamal Obbad , Suhana Bedi , Sanmi Koyejo

Hyperdimensional computing (HDC) is a brain-inspired paradigm valued for its noise robustness, parallelism, energy efficiency, and low computational overhead. Hardware accelerators are being explored to further enhance their performance,…

Emerging Technologies · Computer Science 2025-04-29 Md Mizanur Rahaman Nayan , Che-Kai Liu , Zishen Wan , Arijit Raychowdhury , Azad J Naeemi

Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing…

Machine Learning · Computer Science 2024-05-24 Matthias Chung , Rick Archibald , Paul Atzberger , Jack Michael Solomon

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the…

Databases · Computer Science 2023-08-08 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

Several deep learned lossy compression techniques have been proposed in the recent literature. Most of these are optimized by using either MS-SSIM (multi-scale structural similarity) or MSE (mean squared error) as a loss function.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-02 Yash Patel , Srikar Appalaraju , R. Manmatha