English
Related papers

Related papers: Efficient Representation of Large-Alphabet Probabi…

200 papers

We give three new algorithms for efficient in-place estimation, without using ancilla qubits, of average fidelity of a quantum logic gate acting on a d-dimensional system using much fewer random bits than what was known so far. Previous…

Quantum Physics · Physics 2019-01-23 Aditya Nema , Pranab Sen

Quantum computers have long been expected to efficiently solve complex classical differential equations. Most digital, fault-tolerant approaches use Carleman linearization to map nonlinear systems to linear ones and then apply quantum…

In this paper we introduce a word embedding composition method based on the intuitive idea that a fair embedding representation for a given set of words should satisfy that the new vector will be at the same distance of the vector…

Computation and Language · Computer Science 2024-06-18 Roberto Santana , Mauricio Romero Sicre

A central problem in computational statistics is to convert a procedure for sampling combinatorial from an objects into a procedure for counting those objects, and vice versa. Weconsider sampling problems coming from *Gibbs distributions*,…

Probability · Mathematics 2023-08-21 David G. Harris , Vladimir Kolmogorov

We propose a universal ensemble for random selection of rate-distortion codes, which is asymptotically optimal in a sample-wise sense. According to this ensemble, each reproduction vector, $\hbx$, is selected independently at random under…

Information Theory · Computer Science 2022-12-26 Neri Merhav

Laser light is widely used for communication and sensing applications, so the optimal discrimination of coherent states--the quantum states of light emitted by a laser--has immense practical importance. However, quantum mechanics imposes a…

Quantum Physics · Physics 2013-05-24 Marcus P. da Silva , Saikat Guha , Zachary Dutton

This paper studies the combinatoric structure of the set of all representations, up to equivalence, of a finite-dimensional semisimple Lie algebra. This has intrinsic interest as a previously unsolved problem in representation theory, and…

Quantum Physics · Physics 2007-05-23 William Gordon Ritter

The Key-Value (KV) cache of Large Language Models (LLMs) is prefix-based, making it highly inefficient for processing contexts retrieved in arbitrary order. Position-Independent Caching (PIC) has been proposed to enable KV reuse without…

Machine Learning · Computer Science 2026-02-03 Shiju Zhao , Junhao Hu , Jiaqi Zheng , Guihai Chen

We describe and analyze a simple algorithm for sampling from the solution $\mathbf{x}^* := \mathbf{A}^+\mathbf{b}$ to a linear system $\mathbf{A}\mathbf{x} = \mathbf{b}$. We assume access to a sampler which allows us to draw indices…

Data Structures and Algorithms · Computer Science 2025-08-19 Tyler Chen , Junhyung Lyle Kim , Archan Ray , Shouvanik Chakrabarti , Dylan Herman , Niraj Kumar

Ensembling word embeddings to improve distributed word representations has shown good success for natural language processing tasks in recent years. These approaches either carry out straightforward mathematical operations over a set of…

Computation and Language · Computer Science 2018-08-14 James O' Neill , Danushka Bollegala

We quantify the upper bound on the size of the implicit neural representation (INR) model from a digital perspective. The upper bound of the model size increases exponentially as the required bit-precision increases. To this end, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Woo Kyoung Han , Byeonghun Lee , Hyunmin Cho , Sunghoon Im , Kyong Hwan Jin

Communicating information, like gradient vectors, between computing nodes in distributed and federated learning is typically an unavoidable burden, resulting in scalability issues. Indeed, communication might be slow and costly. Recent…

Machine Learning · Computer Science 2020-10-08 Alyazeed Albasyoni , Mher Safaryan , Laurent Condat , Peter Richtárik

This paper considers the problem of estimating the cumulative distribution function and probability density function of a random variable using data quantized by uniform and non-uniform quantizers. A simple estimator is proposed based on…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Paolo Carbone , Johan Schoukens , István Kollár , Antonio Moschitta

In this paper, we present an approach to integer factorization using distributed representations formed with Vector Symbolic Architectures. The approach formulates integer factorization in a manner such that it can be solved using neural…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Denis Kleyko , Connor Bybee , Christopher J. Kymn , Bruno A. Olshausen , Amir Khosrowshahi , Dmitri E. Nikonov , Friedrich T. Sommer , E. Paxon Frady

Communication is one of the bottlenecks of distributed optimisation and learning. To overcome this bottleneck, we propose a novel quantization method that transforms a vector into a sample of components' indices drawn from a categorical…

Optimization and Control · Mathematics 2025-01-31 Dmitrii Pasechniuk , Pavel Dvurechensky , César A. Uribe , Alexander Gasnikov

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

A diffusion probabilistic model (DPM) is a generative model renowned for its ability to produce high-quality outputs in tasks such as image and audio generation. However, training DPMs on large, high-dimensional datasets such as…

Quantum Physics · Physics 2025-11-05 Yunfei Wang , Ruoxi Jiang , Yingda Fan , Xiaowei Jia , Jens Eisert , Junyu Liu , Jin-Peng Liu

In the past few years, triplet loss-based metric embeddings have become a de-facto standard for several important computer vision problems, most no-tably, person reidentification. On the other hand, in the area of speech recognition the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Roman Vygon , Nikolay Mikhaylovskiy

Mixed-precision quantization (MPQ) suffers from the time-consuming process of searching the optimal bit-width allocation i.e., the policy) for each layer, especially when using large-scale datasets such as ISLVRC-2012. This limits the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Chen Tang , Kai Ouyang , Zenghao Chai , Yunpeng Bai , Yuan Meng , Zhi Wang , Wenwu Zhu

This paper addresses the Quadratic Multiple Constraints Variable-Sized Bin Packing Problem (QMC-VSBPP), a challenging combinatorial optimization problem that generalizes the classical bin packing problem by incorporating multiple capacity…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Natalia A. Santos , Marlon Jeske , Antonio A. Chaves