English
Related papers

Related papers: High-dimensional $p$-norms

200 papers

In this paper, we generalize and improve some fundamental concentration inequalities using information on the random variables' higher moments. In particular, we improve the classical Hoeffding's and Bennett's inequalities for the case…

Probability · Mathematics 2023-04-27 Bar Light

To any $n$-dimensional random vector $X$ we may associate its $L_p$-centroid body ${\cal Z}_p(X)$ and the corresponding norm. We formulate a conjecture concerning the bound on the ${\cal Z}_p(X)$-norm of $X$ and show that it holds under…

Probability · Mathematics 2020-10-27 Rafał Latała

We provide an upper bound as a random variable for the functions of estimators in high dimensions. This upper bound may help establish the rate of convergence of functions in high dimensions. The upper bound random variable may converge…

Econometrics · Economics 2020-08-07 Mehmet Caner , Xu Han

The aim of this paper is to investigate, which infinite dimensional consequences follow from the main results of recently published paper of the authors (2009) (see Theorems 2 and 3). We show that the finite dimensional Theorem 3 implies…

Probability · Mathematics 2012-03-27 Friedrich Götze , Andrei Yu. Zaitsev

The characteristics of data like distribution and heterogeneity, become more complex and counterintuitive as dimensionality increases. This phenomenon is known as curse of dimensionality, where common patterns and relationships (e.g.,…

Machine Learning · Computer Science 2025-03-21 Dehua Peng , Zhipeng Gui , Huayi Wu

This paper develops a quantitative version of de Jong's central limit theorem for homogeneous sums in a high-dimensional setting. More precisely, under appropriate moment assumptions, we establish an upper bound for the Kolmogorov distance…

Probability · Mathematics 2021-09-20 Yuta Koike

This paper deals with the dimension reduction for high-dimensional time series based on common factors. In particular we allow the dimension of time series $p$ to be as large as, or even larger than, the sample size $n$. The estimation for…

Statistics Theory · Mathematics 2010-06-15 Clifford Lam , Qiwei Yao , Neil Bathia

In his 1996 paper, Talagrand highlighted that the Law of Large Numbers (LLN) for independent random variables can be viewed as a geometric property of multidimensional product spaces. This phenomenon is known as the concentration of…

Probability · Mathematics 2025-01-24 Haim Bar , Vladimir Pozdnyakov

The authors have recently obtained a lower bound of the Hausdorff dimension of the sets of vectors $(x_1, \ldots, x_d)\in [0,1)^d$ with large Weyl sums, namely of vectors for which $$ \left| \sum_{n=1}^{N}\exp(2\pi i (x_1 n+\ldots +x_d…

Classical Analysis and ODEs · Mathematics 2019-07-10 Changhao Chen , Igor E. Shparlinski

We provide a simple method and relevant theoretical analysis for efficiently estimating higher-order lp distances. While the analysis mainly focuses on l4, our methodology extends naturally to p = 6,8,10..., (i.e., when p is even).…

Machine Learning · Computer Science 2012-03-19 Ping Li , Michael W. Mahoney , Yiyuan She

Suppose $\left \{ X_{i,k}; 1\le i \le p, 1\le k \le n \right \} $ is an array of i.i.d.~real random variables. Let $\left \{ p=p_{n}; n \ge1 \right \} $ be positive integers. Consider the maximum interpoint distance $M_{n}=\max_{1\le i<…

Probability · Mathematics 2023-12-27 Haibin Zhang , Yong Zhang , Xue Ding

This paper gives a theoretical analysis of high dimensional linear discrimination of Gaussian data. We study the excess risk of linear discriminant rules. We emphasis on the poor performances of standard procedures in the case when…

Statistics Theory · Mathematics 2010-02-19 Robin Girard

Maximum Mean Discrepancy (MMD) has been widely used in the areas of machine learning and statistics to quantify the distance between two distributions in the $p$-dimensional Euclidean space. The asymptotic property of the sample MMD has…

Statistics Theory · Mathematics 2023-08-29 Hanjia Gao , Xiaofeng Shao

We establish the rate of convergence in the strong law of large numbers of discrete Fourier Transform of the identically distributed random variables with finite moment of order p, where 1<p<2.

Probability · Mathematics 2016-02-24 Na Zhang

This paper derives a new strong Gaussian approximation bound for the sum of independent random vectors. The approach relies on the optimal transport theory and yields \textit{explicit} dependence on the dimension size $p$ and the sample…

Statistics Theory · Mathematics 2021-09-06 Nazar Buzun , Nikolay Shvetsov , Dmitry V. Dylov

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states:…

Machine Learning · Computer Science 2020-01-22 Alexander N. Gorban , Valery A. Makarov , Ivan Y. Tyukin

A common approach to statistical learning with big-data is to randomly split it among $m$ machines and learn the parameter of interest by averaging the $m$ individual estimates. In this paper, focusing on empirical risk minimization, or…

Machine Learning · Statistics 2016-06-14 Jonathan Rosenblatt , Boaz Nadler

For any finite point set in $D$-dimensional space equipped with the 1-norm, we present random linear embeddings to $k$-dimensional space, with a new metric, having the following properties. For any pair of points from the point set that are…

Probability · Mathematics 2020-11-09 Michael P. Casey

It has long been noticed that high dimension data exhibits strange patterns. This has been variously interpreted as either a "blessing" or a "curse", causing uncomfortable inconsistencies in the literature. We propose that these patterns…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Wen-Yan Lin

Many high dimensional vector distances tend to a constant. This is typically considered a negative "contrast-loss" phenomenon that hinders clustering and other machine learning techniques. We reinterpret "contrast-loss" as a blessing.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Wen-Yan Lin , Siying Liu , Jian-Huang Lai , Yasuyuki Matsushita