English
Related papers

Related papers: Using Stochastic Encoders to Discover Structure in…

200 papers

This study investigates the problem of learning linear block codes optimized for Belief-Propagation decoders significantly improving performance compared to the state-of-the-art. Our previous research is extended with an enhanced system…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Louis-Adrien Dufrène , Quentin Lampin , Guillaume Larue

Existing gradient coding schemes introduce identical redundancy across the coordinates of gradients and hence cannot fully utilize the computation results from partial stragglers. This motivates the introduction of diverse redundancies…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Qi Wang , Ying Cui , Chenglin Li , Junni Zou , Hongkai Xiong

Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based information…

Information Retrieval · Computer Science 2017-11-15 B Sengupta , E Vasquez , Y Qian

This paper is concerned with scalar quantization of transform coefficients in an audio codec. The generalized Gaussian distribution (GGD) is used as an approximation of one-dimensional probability density function for transform coefficients…

Multimedia · Computer Science 2008-06-27 Boris D. Kudryashov , Anton V. Porov , Eunmi L. Oh

The image tokenizer is a critical component in AR image generation, as it determines how rich and structured visual content is encoded into compact representations. Existing quantization-based tokenizers such as VQ-GAN primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yiang Shi , Xiaoyang Guo , Wei Yin , Mingkai Jia , Qian Zhang , Xiaolin Hu , Wenyu Liu , Xinggang Wang

We present adaptive on-line schemes for lossy encoding of individual sequences under the conditions of the Wyner-Ziv (WZ) problem. In the first part of this article, a set of fixed-rate scalar source codes with zero delay is presented. We…

Information Theory · Computer Science 2009-08-12 Avraham Reani , Neri Merhav

Jointly Gaussian memoryless sources are observed at N distinct terminals. The goal is to efficiently encode the observations in a distributed fashion so as to enable reconstruction of any one of the observations, say the first one, at the…

Information Theory · Computer Science 2008-05-14 Saurabha Tavildar , Pramod Viswanath , Aaron B. Wagner

Vector quantization (VQ) underpins modern generative and representation models by turning continuous latents into discrete tokens. Yet hard nearest-neighbor assignments are non-differentiable and are typically optimized with heuristic…

Machine Learning · Computer Science 2026-02-03 Haochen You , Heng Zhang , Hongyang He , Yuqi Li , Baojing Liu

We present a quantum compilation algorithm that maps Clifford encoders, encoding maps for stabilizer quantum codes, to a unique graphical representation in the ZX calculus. Specifically, we develop a canonical form in the ZX calculus and…

Quantum Physics · Physics 2025-02-11 Andrey Boris Khesin , Jonathan Z. Lu , Peter W. Shor

Variety of machine learning problems can be formulated as an optimization task for some (surrogate) loss function. Calculation of loss function can be viewed in terms of stochastic computation graphs (SCG). We use this formalism to analyze…

Machine Learning · Computer Science 2017-12-18 Eugene Golikov , Vlad Zhukov , Maksim Kretov

This thesis investigates sampling-based quantum algorithms for electronic ground state energy estimation, focusing on Quantum-Selected Configuration Interaction (QSCI) and Sample-Based Quantum Diagonalization (SQD) as near-term alternatives…

Quantum Physics · Physics 2025-09-29 Abdelmouheymen Rabah Khamadja , Mohamed Taha Rouabah

Recent advances in dimensionality reduction have achieved more accurate lower-dimensional embeddings of high-dimensional data. In addition to visualisation purposes, these embeddings can be used for downstream processing, including batch…

Machine Learning · Computer Science 2023-09-07 David Novak , Sofie Van Gassen , Yvan Saeys

A novel coding strategy for block-based compressive sens-ing named spatially directional predictive coding (SDPC) is proposed, which efficiently utilizes the intrinsic spatial cor-relation of natural images. At the encoder, for each block…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Jian Zhang , Debin Zhao , Feng Jiang

Distributed functional scalar quantization (DFSQ) theory provides optimality conditions and predicts performance of data acquisition systems in which a computation on acquired data is desired. We address two limitations of previous works:…

Information Theory · Computer Science 2015-03-24 John Z. Sun , Vinith Misra , Vivek K Goyal

This work extends the generalized nearest neighbor decoding (GNND), originally developed as a receiver architecture for memoryless channels, to a vectorized GNND (Vec-GNND) suitable for in-block memory (IBM) channels. Leveraging the…

Information Theory · Computer Science 2026-05-18 Yuhao Liu , Xinwei Li , Shuqin Pang , Hao Wu , Wenyi Zhang

We propose an approach to symbolic regression based on a novel variational autoencoder for generating hierarchical structures, HVAE. It combines simple atomic units with shared weights to recursively encode and decode the individual nodes…

Machine Learning · Computer Science 2023-09-12 Sebastian Mežnar , Sašo Džeroski , Ljupčo Todorovski

This paper studies fixed-rate randomized vector quantization under the constraint that the quantizer's output has a given fixed probability distribution. A general representation of randomized quantizers that includes the common models in…

Information Theory · Computer Science 2016-11-15 Naci Saldi , Tamás Linder , Serdar Yüksel

We analyze a new group testing scheme, termed semi-quantitative group testing, which may be viewed as a concatenation of an adder channel and a discrete quantizer. Our focus is on non-uniform quantizers with arbitrary thresholds. For the…

Information Theory · Computer Science 2015-06-26 Amin Emad , Olgica Milenkovic

The increasing efficiency and compactness of deep learning architectures, together with hardware improvements, have enabled the complex and high-dimensional modelling of medical volumetric data at higher resolutions. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-14 Petru-Daniel Tudosiu , Thomas Varsavsky , Richard Shaw , Mark Graham , Parashkev Nachev , Sebastien Ourselin , Carole H. Sudre , M. Jorge Cardoso

Variational Quantum Eigensolver (VQE) is a hybrid algorithm for finding the minimum eigenvalue/vector of a given Hamiltonian by optimizing a parametrized quantum circuit (PQC) using a classical computer. Sequential optimization methods,…

Quantum Physics · Physics 2024-05-17 Katsuhiro Endo , Yuki Sato , Rudy Raymond , Kaito Wada , Naoki Yamamoto , Hiroshi C. Watanabe