English
Related papers

Related papers: High-performance BWT-based Encoders

200 papers

Some recent results have introduced external-memory algorithms to compute self-indexes of a set of strings, mainly via computing the Burrows-Wheeler Transform (BWT) of the input strings. The motivations for those results stem from…

Data Structures and Algorithms · Computer Science 2015-06-12 Paola Bonizzoni , Gianluca Della Vedova , Yuri Pirola , Marco Previtali , Raffaella Rizzi

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

The Cosmic Microwave Background (CMB) data analysis and the map-making process rely heavily on the use of spherical harmonics. For suitable pixelizations of the sphere, the (forward and inverse) Fourier transform plays a crucial role in…

The compression-complexity trade-off of lossy compression algorithms that are based on a random codebook or a random database is examined. Motivated, in part, by recent results of Gupta-Verd\'{u}-Weissman (GVW) and their underlying…

Information Theory · Computer Science 2009-04-23 Chris Gioran , Ioannis Kontoyiannis

Convolutional autoencoders are now at the forefront of image compression research. To improve their entropy coding, encoder output is typically analyzed with a second autoencoder to generate per-variable parametrized prior probability…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Benoit Brummer , Christophe De Vleeschouwer

Over the past few years, per-title and per-shot video encoding techniques have demonstrated significant gains as compared to conventional techniques such as constant CRF encoding and the fixed bitrate ladder. These techniques have…

Image and Video Processing · Electrical Eng. & Systems 2025-12-16 Krishna Srikar Durbha , Hassene Tmar , Ping-Hao Wu , Ioannis Katsavounidis , Alan C. Bovik

In this paper we investigate the problem of partitioning an input string T in such a way that compressing individually its parts via a base-compressor C gets a compressed output that is shorter than applying C over the entire T at once.…

Data Structures and Algorithms · Computer Science 2009-06-26 Paolo Ferragina , Igor Nitto , Rossano Venturini

In this paper, we propose a progressive learning paradigm for transformer-based variable-rate image compression. Our approach covers a wide range of compression rates with the assistance of the Layer-adaptive Prompt Module (LPM). Inspired…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Shiyu Qin , Yimin Zhou , Jinpeng Wang , Bin Chen , Baoyi An , Tao Dai , Shu-Tao Xia

The bits-back argument suggests that latent variable models can be turned into lossless compression schemes. Translating the bits-back argument into efficient and practical lossless compression schemes for general latent variable models,…

Machine Learning · Computer Science 2019-10-03 Friso H. Kingma , Pieter Abbeel , Jonathan Ho

Data compression is a popular technique for improving the efficiency of data processing workloads such as SQL queries and more recently, machine learning (ML) with classical batch gradient methods. But the efficacy of such ideas for…

Machine Learning · Computer Science 2019-01-23 Fengan Li , Lingjiao Chen , Yijing Zeng , Arun Kumar , Jeffrey F. Naughton , Jignesh M. Patel , Xi Wu

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

An explicit algorithm for performing Schumacher's noiseless compression of quantum bits is given. This algorithm is based on a combinatorial expression for a particular bijection among binary strings. The algorithm, which adheres to the…

Quantum Physics · Physics 2009-10-30 Richard Cleve , David P. DiVincenzo

In this paper, an algorithm for Quantum Inverse Fast Fourier Transform (QIFFT) is developed to work for quantum data. Analogous to a classical discrete signal, a quantum signal can be represented in Dirac notation, application of QIFFT is a…

Quantum Physics · Physics 2024-09-13 Mayank Roy , Devi Maheswaran

Latent variable models have been successfully applied in lossless compression with the bits-back coding algorithm. However, bits-back suffers from an increase in the bitrate equal to the KL divergence between the approximate posterior and…

In this paper, we propose a novel feature weighting method to address the limitation of existing feature processing methods for tabular data. Typically the existing methods assume equal importance across all samples and features in one…

Machine Learning · Computer Science 2024-05-20 Xinhao Zhang , Zaitian Wang , Lu Jiang , Wanfu Gao , Pengfei Wang , Kunpeng Liu

The field of unsupervised machine translation has seen significant advancement from the marriage of the Transformer and the back-translation algorithm. The Transformer is a powerful generative model, and back-translation leverages…

Computation and Language · Computer Science 2023-12-05 Benjamin Brimacombe , Jiawei Zhou

Intelligent transportation systems (ITS) rely heavily on complete and high-quality spatiotemporal traffic data to achieve optimal performance. Nevertheless, in real-word traffic data collection processes, issues such as communication…

Machine Learning · Computer Science 2025-07-01 Lei Yang

We present LQR-CBF-RRT*, an incremental sampling-based algorithm for offline motion planning. Our framework leverages the strength of Control Barrier Functions (CBFs) and Linear Quadratic Regulators (LQR) to generate safety-critical and…

Robotics · Computer Science 2023-09-28 Guang Yang , Mingyu Cai , Ahmad Ahmad , Amanda Prorok , Roberto Tron , Calin Belta

This paper introduces a new coding algorithm for Framed Pulse Width Modulation (FPWM). The proposed algorithm requires 93% fewer look-up tables (LUTs) than the previous FPWM coding algorithm and increases a bitrate by 25%. The proposed…

Signal Processing · Electrical Eng. & Systems 2019-05-02 Soon-Won Kwon , Hyeon-Min Bae

This study proposes a novel deep-learning-based method for generating reduced representations of turbulent flows that ensures efficient storage and transfer while maintaining high accuracy during decompression. A Swin-Transformer network…

Fluid Dynamics · Physics 2023-09-19 Meng Zhang , Mustafa Z Yousif , Linqi Yu , HeeChang Lim