English
Related papers

Related papers: The Sum Rate of Vector Gaussian Multiple Descripti…

200 papers

This work concentrates on the study of inverse determinant sums, which arise from the union bound on the error probability, as a tool for designing and analyzing algebraic space-time block codes. A general framework to study these sums is…

Information Theory · Computer Science 2013-10-01 Roope Vehkalahti , Hsiao-feng Lu , Laura Luzzi

We consider graphical models based on a recursive system of linear structural equations. This implies that there is an ordering, $\sigma$, of the variables such that each observed variable $Y_v$ is a linear function of a variable specific…

Methodology · Statistics 2019-06-28 Y. Samuel Wang , Mathias Drton

We establish a novel bijective encoding that represents permutations as forests of decorated (or enriched) trees. This allows us to prove local convergence of uniform random permutations from substitution-closed classes satisfying a…

Probability · Mathematics 2020-07-01 Jacopo Borga , Mathilde Bouvel , Valentin Féray , Benedikt Stufler

Rate-distortion formulation is the information-theoretic approach to the study of signal encoding systems. Since a more general approach to model the nonstationarity exhibited by real-world signals is to use appropriately fitted time…

Information Theory · Computer Science 2019-11-01 Jia-Chyi Wu

By extending the breadth first search algorithm to any d-type critical or subcritical irreducible branching forest, we show that such forests may be encoded through d independent, integer valued, d-dimensional random walks. An application…

Probability · Mathematics 2014-03-11 Loïc Chaumont , Rongli Liu

This paper characterizes the values of partial regression coefficients, defined as projection coefficients onto the space spanned by explanatory variables, for random variables generated by linear structural equation models using graphical…

Statistics Theory · Mathematics 2026-03-10 Masato Shimokawa

Guessing Random Additive Noise Decoding (GRAND) and its variants, known for their near-maximum likelihood performance, have been introduced in recent years. One such variant, Segmented GRAND, reduces decoding complexity by generating only…

Information Theory · Computer Science 2025-12-19 Lukas Rapp , Jiewei Feng , Muriel Médard , Ken R. Duffy

This article introduces a flexible and adaptive nonparametric method for estimating the association between multiple covariates and power spectra of multiple time series. The proposed approach uses a Bayesian sum of trees model to capture…

Methodology · Statistics 2021-10-01 Yakun Wang , Zeda Li , Scott A. Bruce

Ridge regularized linear models (RRLMs), such as ridge regression and the SVM, are a popular group of methods that are used in conjunction with coefficient hypothesis testing to discover explanatory variables with a significant multivariate…

Statistics Theory · Mathematics 2015-09-15 Eric V. Strobl , Shyam Visweswaran

We consider a recursive algorithm to construct an aggregated estimator from a finite number of base decision rules in the classification problem. The estimator approximately minimizes a convex risk functional under the l1-constraint. It is…

Statistics Theory · Mathematics 2007-06-13 Anatoli Juditsky , Alexander Nazin , Alexandre Tsybakov , Nicolas Vayatis

We establish a random variable substitution lemma and use it to investigate the role of refinement layer in multiple description coding, which clarifies the relationship among several existing achievable multiple description rate-distortion…

Information Theory · Computer Science 2009-09-18 Jia Wang , Jun Chen , Lei Zhao , Paul Cuff , Haim Permuter

Deep generative models have achieved remarkable success in various data domains, including images, time series, and natural languages. There remain, however, substantial challenges for combinatorial structures, including graphs. One of the…

Machine Learning · Computer Science 2018-09-21 Tengfei Ma , Jie Chen , Cao Xiao

Sign stochastic gradient descent (signSGD) is a communication-efficient method that transmits only the sign of stochastic gradients for parameter updating. Existing literature has demonstrated that signSGD can achieve a convergence rate of…

Machine Learning · Computer Science 2024-12-16 Wei Jiang , Sifan Yang , Wenhao Yang , Lijun Zhang

The classical Gray and Wyner source coding for a simple network for sources that generate a tuple of multivariate, correlated Gaussian random variables $(Y_1,Y_2)$ is re-examined using the geometric approach of Gaussian random variables,…

Information Theory · Computer Science 2021-02-16 Charalambos D. Charalambous , Jan H. van Schuppen

The paper is a sketch of systematic presentation of distributional limit theorems and their refinements for compound sums. When analyzing, e.g., ergodic semi-Markov systems with discrete or continuous time, this allows us to separate those…

Probability · Mathematics 2024-04-29 Vsevolod K. Malinovskii

The capacity region of the multiple access channel with arbitrarily correlated sources remains an open problem. Cover, El Gamal and Salehi gave an achievable region in the form of single-letter entropy and mutual information expressions,…

Information Theory · Computer Science 2007-07-16 W. Kang , S. Ulukus

A geometric setup for constrained variational calculus is presented. The analysis deals with the study of the extremals of an action functional defined on piecewise differentiable curves, subject to differentiable, non-holonomic…

Mathematical Physics · Physics 2015-05-08 Enrico Massa , Danilo Bruno , Gianvittorio Luria , Enrico Pagani

Multivariate extreme value distributions are a common choice for modelling multivariate extremes. In high dimensions, however, the construction of flexible and parsimonious models is challenging. We propose to combine bivariate max-stable…

Methodology · Statistics 2024-12-25 Shuang Hu , Zuoxiang Peng , Johan Segers

Motivated by the construction of tractable robust estimators via convex relaxations, we present conditions on the sample size which guarantee an augmented notion of Restricted Eigenvalue-type condition for Gaussian designs. Such a notion is…

Statistics Theory · Mathematics 2018-12-04 Philip Thompson , Arnak S. Dalalyan

We propose and analyze a new estimator of the covariance matrix that admits strong theoretical guarantees under weak assumptions on the underlying distribution, such as existence of moments of only low order. While estimation of covariance…

Statistics Theory · Mathematics 2018-01-17 Stanislav Minsker , Xiaohan Wei