English
Related papers

Related papers: Minimum HGR Correlation Principle: From Marginals …

200 papers

In this paper, we study the distribution of the minimal distance (in the Hamming metric) of a random linear code of dimension $k$ in $\mathbb{F}_q^n$. We provide quantitative estimates showing that the distribution function of the minimal…

Information Theory · Computer Science 2020-07-15 Jing Hao , Han Huang , Galyna Livshyts , Konstantin Tikhomirov

In this paper we provide a new geometric characterization of the Hirschfeld-Gebelein-R\'{e}nyi maximal correlation of a pair of random $(X,Y)$, as well as of the chordal slope of the nontrivial boundary of the hypercontractivity ribbon of…

Information Theory · Computer Science 2013-04-24 Venkat Anantharam , Amin Gohari , Sudeep Kamath , Chandra Nair

In this work, we investigate the variational problem $$\rho_x^\ast = \text{argmin}_{\rho_x} D(G\#\rho_x, \rho_y)\,, $$ where $D$ quantifies the difference between two probability measures, and ${G}$ is a forward operator that maps a…

Optimization and Control · Mathematics 2025-01-17 Qin Li , Li Wang , Yunan Yang

We give an improved theoretical analysis of score-based generative modeling. Under a score estimate with small $L^2$ error (averaged across timesteps), we provide efficient convergence guarantees for any data distribution with second-order…

Machine Learning · Computer Science 2023-02-03 Hongrui Chen , Holden Lee , Jianfeng Lu

Distribution-on-distribution regression considers the problem of formulating and estimating a regression relationship where both covariate and response are probability distributions. The optimal transport distributional regression model…

Statistics Theory · Mathematics 2022-06-06 Laya Ghodrati , Victor M. Panaretos

Comparing structured data from possibly different metric-measure spaces is a fundamental task in machine learning, with applications in, e.g., graph classification. The Gromov-Wasserstein (GW) discrepancy formulates a coupling between the…

Machine Learning · Computer Science 2022-07-12 Hongwei Jin , Zishun Yu , Xinhua Zhang

Measuring the correlation (association) between two random variables is one of the important goals in statistical applications. In the literature, the covariance between two random variables is a widely used criterion in measuring the…

Methodology · Statistics 2018-10-30 Majid Asadi , Somayeh Zarezadeh

Fix a graph $H$ and some $p\in (0,1)$, and let $X_H$ be the number of copies of $H$ in a random graph $G(n,p)$. Random variables of this form have been intensively studied since the foundational work of Erd\H{o}s and R\'{e}nyi. There has…

Combinatorics · Mathematics 2020-11-19 Jacob Fox , Matthew Kwan , Lisa Sauermann

When Gaussian copula with linear correlation coefficient is used to model correlated random variables, one crucial issue is to determine a suitable correlation coefficient $\rho_z$ in normal space for two variables with correlation…

Methodology · Statistics 2016-08-03 Qing Xiao

In this paper, for centered homogeneous Gaussian random fields the joint limiting distributions of normalized maxima and minima over continuous time and uniform grids are investigated. It is shown that maxima and minima are asymptotic…

Probability · Mathematics 2019-03-29 Yingyin Lu , Zuoxiang Peng

The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and…

Optimization and Control · Mathematics 2025-09-08 Paula Franke , Kay Hamacher , Paul Manns

A method is introduced for approximate marginal likelihood inference via adaptive Gaussian quadrature in mixed models with a single grouping factor. The core technical contribution is an algorithm for computing the exact gradient of the…

Methodology · Statistics 2024-11-13 Alex Stringer

The $\boldsymbol{\beta}$-model for random graphs is commonly used for representing pairwise interactions in a network with degree heterogeneity. Going beyond pairwise interactions, Stasi et al. (2014) introduced the hypergraph…

Statistics Theory · Mathematics 2024-06-07 Sagnik Nandy , Bhaswar B. Bhattacharya

We consider marginal log-linear models for parameterizing distributions on multidimensional contingency tables. These models generalize ordinary log-linear and multivariate logistic models, besides several others. First, we obtain some…

Statistics Theory · Mathematics 2019-10-25 S. Ghosh , P. Vellaisamy

In this paper we propose and study a class of simple, nonparametric, yet interpretable measures of association between two random variables $X$ and $Y$ taking values in general topological spaces. These nonparametric measures -- defined…

Statistics Theory · Mathematics 2020-10-09 Nabarun Deb , Promit Ghosal , Bodhisattva Sen

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese

Consider~\(n\) nodes~\(\{X_i\}_{1 \leq i \leq n}\) independently distributed in the unit square~\(S,\) each according to a distribution~\(f.\) Nodes~\(X_i\) and~\(X_j\) are joined by an edge if the Euclidean distance~\(d(X_i,X_j)\) is less…

Probability · Mathematics 2021-03-02 Ghurumuruhan Ganesan

Let $\{X_{1},\ldots,X_{N_1}\}$ and $\{Y_{1},\ldots,Y_{N_2}\}$ be two sequences of interdependent heterogeneous samples, where for $i=1,\ldots,N_{1},$ $X_{i}\sim \text{Kw-G}(x, \alpha_{i}, \gamma_{i};G)$ and for $i=1,\ldots,N_{2},$…

Statistics Theory · Mathematics 2025-08-21 Sangita Das , Narayanaswamy Balakrishnan

Maxima of the linear density field form a point process that can be used to understand the spatial distribution of virialized halos that collapsed from initially overdense regions. However, owing to the peak constraint, clustering…

Cosmology and Nongalactic Astrophysics · Physics 2013-05-30 Vincent Desjacques

We fully characterize the nonasymptotic minimax separation rate for sparse signal detection in the Gaussian sequence model with $p$ equicorrelated observations, generalizing a result of Collier, Comminges, and Tsybakov. As a consequence of…

Statistics Theory · Mathematics 2021-10-26 Subhodh Kotekal , Chao Gao