English
Related papers

Related papers: Efficient Compression Technique for Sparse Sets

200 papers

An appealing requirement from the well-known diffraction tomography (DT) exists for success reconstruction from few-view and limited-angle data. Inspired by the well-known compressive sensing (CS), the accurate super-resolution…

Computational Engineering, Finance, and Science · Computer Science 2009-04-20 Lianlin Li , Wenji Zhang , Fang Li

In this paper we exploit concepts of information theory to address the fundamental problem of identifying and defining the most suitable tools to extract, in a automatic and agnostic way, information from a generic string of characters. We…

Statistical Mechanics · Physics 2009-11-10 Andrea Baronchelli , Emanuele Caglioti , Vittorio Loreto

A "bigger is better" explosion in the number of parameters in deep neural networks has made it increasingly challenging to make state-of-the-art networks accessible in compute-restricted environments. Compression techniques have taken on…

Computation and Language · Computer Science 2021-10-08 Orevaoghene Ahia , Julia Kreutzer , Sara Hooker

The last two decades have seen tremendous growth in data collections because of the realization of recent technologies, including the internet of things (IoT), E-Health, industrial IoT 4.0, autonomous vehicles, etc. The challenge of data…

Information Theory · Computer Science 2022-10-03 Vidhi Agrawal , Gajraj Kuldeep , Dhananjoy Dey

In several applications, input samples are more naturally represented in terms of similarities between each other, rather than in terms of feature vectors. In these settings, machine-learning algorithms can become very computationally…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Fabio Roli

We introduce simple, efficient algorithms for computing a MinHash of a probability distribution, suitable for both sparse and dense data, with equivalent running times to the state of the art for both cases. The collision probability of…

Data Structures and Algorithms · Computer Science 2019-01-04 Ryan Moulton , Yunjiang Jiang

Compressed sensing is a signal processing technique that allows for the reconstruction of a signal from a small set of measurements. The key idea behind compressed sensing is that many real-world signals are inherently sparse, meaning that…

Machine Learning · Computer Science 2025-09-16 Shane Stevenson , Maryam Sabagh

We present a data compression and dimensionality reduction scheme for data fusion and aggregation applications to prevent data congestion and reduce energy consumption at network connecting points such as cluster heads and gateways. Our…

Networking and Internet Architecture · Computer Science 2014-08-14 Mohammad Abu Alsheikh , Puay Kai Poh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

Several deep learned lossy compression techniques have been proposed in the recent literature. Most of these are optimized by using either MS-SSIM (multi-scale structural similarity) or MSE (mean squared error) as a loss function.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-02 Yash Patel , Srikar Appalaraju , R. Manmatha

Given a static reference string $R$ and a source string $S$, a relative compression of $S$ with respect to $R$ is an encoding of $S$ as a sequence of references to substrings of $R$. Relative compression schemes are a classic model of…

Data Structures and Algorithms · Computer Science 2016-09-19 Philip Bille , Patrick Hagge Cording , Inge Li Gørtz , Frederik Rye Skjoldjensen , Hjalte Wedel Vildhøj , Søren Vind

Localizing an image wrt. a 3D scene model represents a core task for many computer vision applications. An increasing number of real-world applications of visual localization on mobile devices, e.g., Augmented Reality or autonomous robots…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Federico Camposeco , Andrea Cohen , Marc Pollefeys , Torsten Sattler

Compressed sensing allows perfect recovery of sparse signals (or signals sparse in some basis) using only a small number of random measurements. Existing results in compressed sensing literature have focused on characterizing the achievable…

Information Theory · Computer Science 2015-05-18 Dmitry Malioutov , Sujay Sanghavi , Alan Willsky

Driven by the ``scale-is-everything'' paradigm, modern machine learning increasingly demands ever-larger datasets and models, yielding prohibitive computational and storage requirements. Dataset distillation mitigates this by compressing an…

Machine Learning · Computer Science 2025-07-24 Youneng Bao , Yiping Liu , Zhuo Chen , Yongsheng Liang , Mu Li , Kede Ma

Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing…

Machine Learning · Computer Science 2015-10-26 Saiprasad Ravishankar , Yoram Bresler

Mapping is crucial in robotics for localization and downstream decision-making. As robots are deployed in ever-broader settings, the maps they rely on continue to increase in size. However, storing these maps indefinitely (cold storage),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Mohammad Omama , Po-han Li , Harsh Goel , Minkyu Choi , Behdad Chalaki , Vaishnav Tadiparthi , Hossein Nourkhiz Mahjoub , Ehsan Moradi Pari , Sandeep P. Chinchali

Compressed sensing is a theory which guarantees the exact recovery of sparse signals from a small number of linear projections. The sampling schemes suggested by current compressed sensing theories are often of little practical relevance…

Information Theory · Computer Science 2014-07-22 Jérémie Bigot , Claire Boyer , Pierre Weiss

Recent research has shown that performance in signal processing tasks can often be significantly improved by using signal models based on sparse representations, where a signal is approximated using a small number of elements from a fixed…

Optimization and Control · Mathematics 2011-11-18 Adam S. Charles , Pierre Garrigues , Christopher J. Rozell

In this paper, we contend that a natural objective of representation learning is to compress and transform the distribution of the data, say sets of tokens, towards a low-dimensional Gaussian mixture supported on incoherent subspaces. The…

Machine Learning · Computer Science 2024-09-09 Yaodong Yu , Sam Buchanan , Druv Pai , Tianzhe Chu , Ziyang Wu , Shengbang Tong , Hao Bai , Yuexiang Zhai , Benjamin D. Haeffele , Yi Ma

Sparse representation of 3D images is considered within the context of data reduction. The goal is to produce high quality approximations of 3D images using fewer elementary components than the number of intensity points in the 3D array.…

Image and Video Processing · Electrical Eng. & Systems 2019-06-12 Laura Rebollo-Neira , Daniel Whitehouse

Various grammar compression algorithms have been proposed in the last decade. A grammar compression is a restricted CFG deriving the string deterministically. An efficient grammar compression develops a smaller CFG by finding duplicated…

Data Structures and Algorithms · Computer Science 2016-09-01 Shouhei Fukunaga , Yoshimasa Takabatake , I Tomohiro , Hiroshi Sakamoto