English
Related papers

Related papers: Value-Compressed Sparse Column (VCSC): Sparse Matr…

200 papers

In deep learning inference, model parameters are pruned and quantized to reduce the model size. Compression methods and common subexpression (CSE) elimination algorithms are applied on sparse constant matrices to deploy the models on…

Machine Learning · Computer Science 2023-03-29 Emre Bilgili , Arda Yurdakul

Video compression is widely used in digital television, surveillance systems, and virtual reality. Real-time video decoding is crucial in practical scenarios. Recently, neural video compression (NVC) combines traditional coding with deep…

Image and Video Processing · Electrical Eng. & Systems 2023-12-20 Siyu Zhang , Wendong Mao , Huihong Shi , Zhongfeng Wang

Structured sparsity has been proposed as an efficient way to prune the complexity of modern Machine Learning (ML) applications and to simplify the handling of sparse data in hardware. The acceleration of ML models - for both training and…

Hardware Architecture · Computer Science 2023-11-14 V. Titopoulos , K. Alexandridis , C. Peltekis , C. Nicopoulos , G. Dimitrakopoulos

High-dimensional sparse data emerge in many critical application domains such as healthcare and cybersecurity. To extract meaningful insights from massive volumes of these multi-dimensional data, scientists employ unsupervised analysis…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Jan Laukemann , Ahmed E. Helal , S. Isaac Geronimo Anderson , Fabio Checconi , Yongseok Soh , Jesmin Jahan Tithi , Teresa Ranadive , Brian J Gravelle , Fabrizio Petrini , Jee Choi

A property of sparse representations in relation to their capacity for information storage is discussed. It is shown that this feature can be used for an application that we term Encrypted Image Folding. The proposed procedure is realizable…

Computer Vision and Pattern Recognition · Computer Science 2012-09-13 James Bowley , Laura Rebollo-Neira

Data compression is widely used in contemporary column-oriented DBMSes to lower space usage and to speed up query processing. Pioneering systems have introduced compression to tackle the disk bandwidth bottleneck by trading CPU processing…

Databases · Computer Science 2021-05-20 Alexander Slesarev , Evgeniy Klyuchikov , Kirill Smirnov , George Chernishev

In compressed sensing, we wish to reconstruct a sparse signal $x$ from observed data $y$. In sparse coding, on the other hand, we wish to find a representation of an observed signal $y$ as a sparse linear combination, with coefficients $x$,…

Computer Vision and Pattern Recognition · Computer Science 2013-11-25 Will Landecker , Rick Chartrand , Simon DeDeo

Sparse-dense linear algebra is crucial in many domains, but challenging to handle efficiently on CPUs, GPUs, and accelerators alike; multiplications with sparse formats like CSR and CSF require indirect memory lookups. In this work, we…

Hardware Architecture · Computer Science 2020-12-15 Paul Scheffler , Florian Zaruba , Fabian Schuiki , Torsten Hoefler , Luca Benini

Modern data analytics applications prefer to use column-storage formats due to their improved storage efficiency through encoding and compression. Parquet is the most popular file format for column data storage that provides several of…

Databases · Computer Science 2022-12-14 Majid Saeedan , Ahmed Eldawy

Compressed sensing (sparse signal recovery) has been a popular and important research topic in recent years. By observing that natural signals are often nonnegative, we propose a new framework for nonnegative signal recovery using…

Methodology · Statistics 2013-10-04 Ping Li , Cun-Hui Zhang , Tong Zhang

Reliable and energy-efficient wireless data transmission remains a major challenge in resource-constrained wireless neural recording tasks, where data compression is generally adopted to relax the burdens on the wireless data link.…

Information Theory · Computer Science 2016-02-02 Biao Sun , Wenfeng Zhao , Xinshan Zhu

Exascale computing promises quantities of data too large to efficiently store and transfer across networks in order to be able to analyze and visualize the results. We investigate Compressive Sensing (CS) as a way to reduce the size of the…

Information Theory · Computer Science 2015-08-27 Maher Salloum , Nathan Fabian , David M. Hensinger , Jeremy A. Templeton

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications. They also find application in various data storage systems because of their…

Information Theory · Computer Science 2021-01-26 Siyi Yang , Ahmed Hareedy , Shyam Venkatasubramanian , Robert Calderbank , Lara Dolecek

Currently, progressively larger deep neural networks are trained on ever growing data corpora. As this trend is only going to increase in the future, distributed training schemes are becoming increasingly relevant. A major issue in…

Machine Learning · Computer Science 2018-05-23 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

This study develops a unified Point Cloud Geometry (PCG) compression method through the processing of multiscale sparse tensor-based voxelized PCG. We call this compression method SparsePCGC. The proposed SparsePCGC is a low complexity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Jianqiang Wang , Dandan Ding , Zhu Li , Xiaoxing Feng , Chuntong Cao , Zhan Ma

Coded compressed sensing is an algorithmic framework tailored to sparse recovery in very large dimensional spaces. This framework is originally envisioned for the unsourced multiple access channel, a wireless paradigm attuned to…

Information Theory · Computer Science 2019-10-23 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

Subspace clustering is the problem of partitioning unlabeled data points into a number of clusters so that data points within one cluster lie approximately on a low-dimensional linear subspace. In many practical scenarios, the…

Machine Learning · Statistics 2019-01-24 Yining Wang , Yu-Xiang Wang , Aarti Singh

Sparse representation leads to an efficient way to approximately recover a signal by the linear composition of a few bases from a learnt dictionary, based on which various successful applications have been achieved. However, in the scenario…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Xiang Zhang , Jiarui Sun , Siwei Ma , Zhouchen Lin , Jian Zhang , Shiqi Wang , Wen Gao

Sparse subspace clustering (SSC) is one of the current state-of-the-art methods for partitioning data points into the union of subspaces, with strong theoretical guarantees. However, it is not practical for large data sets as it requires…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Maryam Abdolali , Nicolas Gillis , Mohammad Rahmati

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processing communities, tackling some of the limitations of traditional patch-based sparse representations. Although several works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Vardan Papyan , Yaniv Romano , Jeremias Sulam , Michael Elad