中文
相关论文

相关论文: Another look at expurgated bounds and their statis…

200 篇论文

Generalized Zeckendorf decompositions are expansions of integers as sums of elements of solutions to recurrence relations. The simplest cases are base-$b$ expansions, and the standard Zeckendorf decomposition uses the Fibonacci sequence.…

概率论 · 数学 2016-05-17 Iddo Ben-Ari , Steven J. Miller

In this paper, we consider a "compensated" random sum that arises from numerical approximation of stochastic integrations and differential equations. We show that the compensated sum exhibits some surprising cancellations among its…

概率论 · 数学 2024-01-30 Yanghui Liu

A locally recoverable code (LRC code) is a code over a finite alphabet such that every symbol in the encoding is a function of a small number of other symbols that form a recovering set. In this paper we derive new finite-length and…

信息论 · 计算机科学 2016-03-10 Itzhak Tamo , Alexander Barg , Alexey Frolov

We consider upper bounds on the error probability in channel coding. We derive an improved maximum-likelihood union bound, which takes into account events where the likelihood of the correct codeword is tied with that of some competitors.…

信息论 · 计算机科学 2013-02-12 Eli Haim , Yuval Kochman , Uri Erez

We introduce new probabilistic arguments to derive optimal-order central moment bounds in planar directed last-passage percolation. Our technique is based on couplings with the increment-stationary variants of the model, and is presented in…

概率论 · 数学 2025-02-04 Elnur Emrah , Nicos Georgiou , Janosch Ortmann

Separating codes have their applications in collusion-secure fingerprinting for generic digital data, while they are also related to the other structures including hash family, intersection code and group testing. In this paper we study…

信息论 · 计算机科学 2013-11-25 Ryul Kim , Myong-Son Sin , Ok-Hyon Song

We consider the problem of model selection type aggregation in the context of density estimation. We first show that empirical risk minimization is sub-optimal for this problem and it shares this property with the exponential weights…

统计理论 · 数学 2016-09-29 Pierre C. Bellec

This paper computationally obtains optimal bounded-weight, binary, error-correcting codes for a variety of distance bounds and dimensions. We compare the sizes of our codes to the sizes of optimal constant-weight, binary, error-correcting…

信息论 · 计算机科学 2007-10-15 Russell Bent , Michael Schear , Lane A. Hemaspaandra , Gabriel Istrate

In this paper, parameterized Gallager's first bounding technique (GFBT) is presented by introducing nested Gallager regions, to derive upper bounds on the ML decoding error probability of general codes over AWGN channels. The three…

信息论 · 计算机科学 2013-12-30 Qiutao Zhuang , Jia Liu , Xiao Ma

We introduce a new PAC-Bayes oracle bound for unbounded losses that extends Cram\'er-Chernoff bounds to the PAC-Bayesian setting. The proof technique relies on controlling the tails of certain random variables involving the Cram\'er…

机器学习 · 统计学 2024-10-31 Ioar Casado , Luis A. Ortega , Aritz Pérez , Andrés R. Masegosa

This paper studies expurgated exponents for joint source-channel coding of discrete memoryless sources and channels under i.i.d. random coding. We show that a two-class partitioning of source sequences, where the codeword distribution…

信息论 · 计算机科学 2026-01-22 Seyed AmirPouya Moeini , Albert Guillén i Fàbregas

Mixture distributions arise in many parametric and non-parametric settings -- for example, in Gaussian mixture models and in non-parametric estimation. It is often necessary to compute the entropy of a mixture, but, in most cases, this…

信息论 · 计算机科学 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey

We consider a bound on the bias reduction of a random number generator by processing based on binary linear codes. We introduce a new bound on the total variation distance of the processed output based on the weight distribution of the code…

信息论 · 计算机科学 2014-05-13 Alessio Meneghetti , Massimiliano Sala , Alessandro Tomasi

Kolmogorov's exponential inequalities are basic tools for studying the strong limit theorems such as the classical laws of the iterated logarithm for both independent and dependent random variables. This paper establishes the Kolmogorov…

概率论 · 数学 2020-05-08 Li-Xin Zhang

We investigate threshold-based multi-trial decoding of concatenated codes with an inner Maximum-Likelihood decoder and an outer error/erasure (L+1)/L-extended Bounded Distance decoder, i.e. a decoder which corrects e errors and t erasures…

信息论 · 计算机科学 2012-02-07 Christian Senger , Vladimir R. Sidorenko , Martin Bossert , Victor V. Zyablov

We consider the lossless compression bound of any individual data sequence. If we fit the data by a parametric model, the entropy quantity $nH({\hat \theta}_n)$ obtained by plugging in the maximum likelihood estimate is an underestimate of…

信息论 · 计算机科学 2024-01-23 Lei M Li

An extractor is a function E that is used to extract randomness. Given an imperfect random source X and a uniform seed Y, the output E(X,Y) is close to uniform. We study properties of such functions in the presence of prior quantum…

量子物理 · 物理学 2008-02-04 Robert Koenig , Barbara M. Terhal

The problem of coding for networks experiencing worst-case symbol errors is considered. We argue that this is a reasonable model for highly dynamic wireless network transmissions. We demonstrate that in this setup prior network…

信息论 · 计算机科学 2015-10-13 Qiwen Wang , Sidharth Jaggi

Exponential error bounds for the finite-alphabet interference channel (IFC) with two transmitter-receiver pairs, are investigated under the random coding regime. Our focus is on optimum decoding, as opposed to heuristic decoding rules that…

信息论 · 计算机科学 2008-10-14 Raul Etkin , Neri Merhav , Erik Ordentlich

New bounds on the cardinality of permutation codes equipped with the Ulam distance are presented. First, an integer-programming upper bound is derived, which improves on the Singleton-type upper bound in the literature for some lengths.…

信息论 · 计算机科学 2015-04-21 Faruk Göloğlu , Jüri Lember , Ago-Erik Riet , Vitaly Skachek