English
Related papers

Related papers: Asymptotic Frame Theory for Analog Coding

200 papers

We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. Here, regularized autoencoders provide a popular approach by learning the identity mapping on the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Alexander Bauer , Shinichi Nakajima , Klaus-Robert Müller

We put forth new models for universal channel coding. Unlike standard codes which are designed for a specific type of channel, our most general universal code makes communication resilient on every channel, provided the noise level is below…

Information Theory · Computer Science 2022-12-12 Bruno Bauwens , Marius Zimand

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical side, by decomposing…

Statistics Theory · Mathematics 2019-11-27 Hanyuan Hang

When multiple investigators analyze a common dataset, the data reuse induces dependence across testing procedures, affecting the distribution of errors. Existing techniques of managing dependent tests require either cross-study coordination…

Statistics Theory · Mathematics 2026-04-10 Reid Dale , Jordan Rodu , Maria E. Currie , Mike Baiocchi

Term Coding asks: given a finite system of term identities $\Gamma$ in $v$ variables, how large can its solution set be on an $n$--element alphabet, when we are free to choose the interpretations of the function symbols? This turns familiar…

Information Theory · Computer Science 2026-01-26 Søren Riis

Neural Collapse (NC) is a well-known phenomenon of deep neural networks in the terminal phase of training (TPT). It is characterized by the collapse of features and classifier into a symmetrical structure, known as simplex equiangular tight…

Machine Learning · Computer Science 2023-10-13 Peifeng Gao , Qianqian Xu , Yibo Yang , Peisong Wen , Huiyang Shao , Zhiyong Yang , Bernard Ghanem , Qingming Huang

This paper considers error probabilities of random codes for memoryless channels in the fixed-rate regime. Random coding is a fundamental scheme to achieve the channel capacity and many studies have been conducted for the asymptotics of the…

Information Theory · Computer Science 2017-07-17 Junya Honda

We introduce the class of partition-balanced families of codes, and show how to exploit their combinatorial invariants to obtain upper and lower bounds on the number of codes that have a prescribed property. In particular, we derive precise…

Information Theory · Computer Science 2018-12-13 Eimear Byrne , Alberto Ravagnani

Random Matrix Theory (RMT) is capable of making predictions for the spectral fluctuations of a physical system only after removing the influence of the level density by unfolding the spectra. When the level density is known, unfolding is…

Statistical Mechanics · Physics 2013-12-16 Ashraf A. Abul-Magd , Adel Y. Abul-Magd

A method to derive features of modal eigenvalue traces from known and understood solutions is proposed. It utilizes the concept of subduction from point group theory to obtain the symmetry properties of a target structure from those of a…

Signal Processing · Electrical Eng. & Systems 2024-06-06 Lukas Grundmann , Lukas Warkentin , Dirk Manteuffel

We consider sequential detection based on quantized data in the presence of eavesdropper. Stochastic encryption is employed as a counter measure that flips the quantization bits at each sensor according to certain probabilities, and the…

Information Theory · Computer Science 2017-03-08 Jiangfan Zhang , Xiaodong Wang

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue distributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be derived directly as a consequence of two common…

Information Theory · Computer Science 2007-07-13 Matthew J. M. Peacock , Iain B. Collings , Michael L. Honig

This paper considers '$\delta$-almost Reed-Muller codes', i.e., linear codes spanned by evaluations of all but a $\delta$ fraction of monomials of degree at most $d$. It is shown that for any $\delta > 0$ and any $\varepsilon>0$, there…

Information Theory · Computer Science 2021-10-07 Emmanuel Abbe , Jan Hązła , Ido Nachum

Inspired by "quantum graphity" models for spacetime, a statistical model of graphs is proposed to explore possible realizations of emergent manifolds. Graphs with given numbers of vertices and edges are considered, governed by a very…

General Relativity and Quantum Cosmology · Physics 2013-04-09 Si Chen , Steven S. Plotkin

We study the asymptotics of large, moderate and normal deviations for the connected components of the sparse random graph by the method of stochastic processes. We obtain the logarithmic asymptotics of large deviations of the joint…

Probability · Mathematics 2007-05-23 Anatolii A. Puhalskii

Recently we introduced a family of $U(N)$ invariant Random Matrix Ensembles which is characterized by a parameter $\lambda$ describing logarithmic soft-confinement potentials $V(H) \sim [\ln H]^{(1+\lambda)} \:(\lambda>0$). We showed that…

Disordered Systems and Neural Networks · Physics 2013-05-29 Jinmyung Choi , K. A. Muttalib

We consider $n\times n$ random matrices $M_{n}=\sum_{\alpha =1}^{m}{\tau _{\alpha }}\mathbf{y}_{\alpha }\otimes \mathbf{y}_{\alpha }$, where $\tau _{\alpha }\in \mathbb{R}$, $\{\mathbf{y}_{\alpha }\}_{\alpha =1}^{m}$ are i.i.d. isotropic…

Probability · Mathematics 2013-12-02 O. Guédon , A. Lytova , A. Pajor , L. Pastur

It has been observed that an interesting class of non-Gaussian stationary processes is obtained when in the harmonics of a signal with random amplitudes and phases, frequencies can also vary randomly. In the resulting models, the…

Probability · Mathematics 2019-11-19 Anastassia Baxevani , Krzysztof Podgórski

Ensemble methods that average over a collection of independent predictors that are each limited to a subsampling of both the examples and features of the training data command a significant presence in machine learning, such as the…

Machine Learning · Statistics 2020-03-26 Daniel LeJeune , Hamid Javadi , Richard G. Baraniuk

In the present paper we introduce and study finite point subsets of a special kind, called optimum distributions, in the n-dimensional unit cube. Such distributions are closely related with known (delta,s,n)-nets of low discrepancy. It…

Combinatorics · Mathematics 2007-07-16 M. M. Skriganov