English
Related papers

Related papers: Domain Specific Hierarchical Huffman Encoding

200 papers

Compression algorithms reduce the redundancy in data representation to decrease the storage required for that data. Data compression offers an attractive approach to reducing communication costs by using available bandwidth effectively.…

Performance · Computer Science 2007-05-23 B. S. Shajeemohan , Dr. V. K. Govindan

Tries are popular data structures for storing a set of strings, where common prefixes are represented by common root-to-node paths. Over fifty years of usage have produced many variants and implementations to overcome some of their…

Data Structures and Algorithms · Computer Science 2011-12-06 Roberto Grossi , Giuseppe Ottaviano

Recently, semantic parsing has attracted much attention in the community. Although many neural modeling efforts have greatly improved the performance, it still suffers from the data scarcity issue. In this paper, we propose a novel semantic…

Computation and Language · Computer Science 2020-06-24 Zechang Li , Yuxuan Lai , Yansong Feng , Dongyan Zhao

Multi-domain text classification can automatically classify texts in various scenarios. Due to the diversity of human languages, texts with the same label in different domains may differ greatly, which brings challenges to the multi-domain…

Computation and Language · Computer Science 2022-04-27 Xuefeng Li , Hao Lei , Liwen Wang , Guanting Dong , Jinzheng Zhao , Jiachi Liu , Weiran Xu , Chunyun Zhang

Through reading the documentation in the context, tool-using language models can dynamically extend their capability using external tools. The cost is that we have to input lengthy documentation every time the model needs to use the tool,…

Computation and Language · Computer Science 2024-07-03 Yang Xu , Yunlong Feng , Honglin Mu , Yutai Hou , Yitong Li , Xinghao Wang , Wanjun Zhong , Zhongyang Li , Dandan Tu , Qingfu Zhu , Min Zhang , Wanxiang Che

In recent years, with the development of deep neural networks, end-to-end optimized image compression has made significant progress and exceeded the classic methods in terms of rate-distortion performance. However, most learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Meng Li , Shangyin Gao , Yihui Feng , Yibo Shi , Jing Wang

We study the new problem of Huffman-like codes subject to individual restrictions on the code-word lengths of a subset of the source words. These are prefix codes with minimal expected code-word length for a random source where additionally…

Information Theory · Computer Science 2007-07-13 Paul M. B. Vitanyi , Zvi Lotker

Frequency estimation of elements is an important task for summarizing data streams and machine learning applications. The problem is often addressed by using streaming algorithms with sublinear space data structures. These algorithms allow…

Data Structures and Algorithms · Computer Science 2022-04-05 Nikita Seleznev , Senthil Kumar , C. Bayan Bruss

Finite-context models (FCMs) are widely used for compressing symbolic sequences such as DNA, where predictive performance depends critically on the context length k and smoothing parameter {\alpha}. In practice, these hyperparameters are…

Machine Learning · Statistics 2026-03-23 José Contente , Ana Martins , Armando J. Pinho , Sónia Gouveia

Deep Neural Network (DNN) has gained unprecedented performance due to its automated feature extraction capability. This high order performance leads to significant incorporation of DNN models in different Internet of Things (IoT)…

Machine Learning · Computer Science 2020-10-09 Rahul Mishra , Hari Prabhat Gupta , Tanima Dutta

We analyze the performance of a linear code used for a data compression of Slepian-Wolf type. In our framework, two correlated data are separately compressed into codewords employing Gallager-type codes and casted into a communication…

Disordered Systems and Neural Networks · Physics 2007-05-23 Tatsuto Murayama

As the Internet grows in size, so does the amount of text based information that exists. For many application spaces it is paramount to isolate and identify texts that relate to a particular topic. While one-class classification would be…

Artificial Intelligence · Computer Science 2021-11-02 Sameer Khanna

Graph compression is a data analysis technique that consists in the replacement of parts of a graph by more general structural patterns in order to reduce its description length. It notably provides interesting exploration tools for the…

Data Structures and Algorithms · Computer Science 2018-07-19 Robin Lamarche-Perrin

This article shows that any type of binary data can be defined as a collection from codewords of variable length. This feature helps us to define an Injective and surjective function from the suggested codewords to the required codewords.…

Information Theory · Computer Science 2021-10-05 Parviz Gharehbagheri , Sayeed Hamid Haji Sayeed Javadi , Parvaneh Asghari , Naser Gharehbagheri

For a given independent and identically distributed (i.i.d.) source, Huffman code achieves the optimal average codeword length in the class of instantaneous code with a single code table. However, it is known that there exist time-variant…

Information Theory · Computer Science 2022-09-20 Kengo Hashimoto , Ken-ichi Iwata

Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting…

Computation and Language · Computer Science 2022-02-08 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

Social network stores and disseminates a tremendous amount of user shared images. Deep hashing is an efficient indexing technique to support large-scale social image retrieval, due to its deep representation capability, fast retrieval speed…

Information Retrieval · Computer Science 2020-06-11 Lei Zhu , Hui Cui , Zhiyong Cheng , Jingjing Li , Zheng Zhang

Data-driven artificial intelligence (AI) techniques are becoming prominent for learning in support of data compression, but are focused on standard problems such as text compression. To instead address the emerging problem of semantic…

Information Theory · Computer Science 2024-04-05 Haizi Yu , Lav R. Varshney

By using unsupervised domain adaptation (UDA), knowledge can be transferred from a label-rich source domain to a target domain that contains relevant information but lacks labels. Many existing UDA algorithms suffer from directly using raw…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Le Luo , Bingrong Xu , Qingyong Zhang , Cheng Lian , Jie Luo

With the rapid growth of image and video data on the web, hashing has been extensively studied for image or video search in recent years. Benefit from recent advances in deep learning, deep hashing methods have achieved promising results…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Qi Li , Zhenan Sun , Ran He , Tieniu Tan