English
Related papers

Related papers: Breaking the curse of dimensionality in structured…

200 papers

We introduce a nonparametric way to estimate the global probability density function for a random persistence diagram. Precisely, a kernel density function centered at a given persistence diagram and a given bandwidth is constructed. Our…

Statistics Theory · Mathematics 2018-03-14 Joshua Lee Mike , Vasileios Maroulas

Graph contrastive learning is a general learning paradigm excelling at capturing invariant information from diverse perturbations in graphs. Recent works focus on exploring the structural rationale from graphs, thereby increasing the…

Machine Learning · Computer Science 2024-04-09 Qirui Ji , Jiangmeng Li , Jie Hu , Rui Wang , Changwen Zheng , Fanjiang Xu

In this paper we derive new upper bounds for the densities of measurable sets in R^n which avoid a finite set of prescribed distances. The new bounds come from the solution of a linear programming problem. We apply this method to obtain new…

Combinatorics · Mathematics 2010-09-17 Fernando Mario de Oliveira Filho , Frank Vallentin

The Markov property is widely imposed in analysis of time series data. Correspondingly, testing the Markov property, and relatedly, inferring the order of a Markov model, are of paramount importance. In this article, we propose a…

Machine Learning · Statistics 2023-05-31 Yunzhe Zhou , Chengchun Shi , Lexin Li , Qiwei Yao

In this paper we consider the problem of graph-based transductive classification, and we are particularly interested in the directed graph scenario which is a natural form for many real world applications. Different from existing research…

Computer Vision and Pattern Recognition · Computer Science 2014-03-19 Jaydeep De , Xiaowei Zhang , Li Cheng

The problem of graphical model selection is to correctly estimate the graph structure of a Markov random field given samples from the underlying distribution. We analyze the information-theoretic limitations of the problem of graph…

Information Theory · Computer Science 2009-05-19 Narayana Santhanam , Martin J. Wainwright

We consider the problem of repetitive scenario design where one has to solve repeatedly a scenario design problem and can adjust the sample size (number of scenarios) to obtain a desired level of risk (constraint violation probability). We…

Optimization and Control · Mathematics 2025-09-08 Guillaume O. Berger , Raphaël M. Jungers

This paper develops several average-case reduction techniques to show new hardness results for three central high-dimensional statistics problems, implying a statistical-computational gap induced by robustness, a detection-recovery gap and…

Computational Complexity · Computer Science 2020-05-20 Matthew Brennan , Guy Bresler

The graphical notion of effective resistance has found wide-ranging applications in many areas of pure mathematics, applied mathematics and control theory. By the nature of its construction, effective resistance can only be computed in…

Optimization and Control · Mathematics 2013-10-23 George Forrest Young , Luca Scardovi , Naomi Ehrich Leonard

Understanding causal relationships among the variables of a system is paramount to explain and control its behavior. For many real-world systems, however, the true causal graph is not readily available and one must resort to predictions…

Machine Learning · Statistics 2024-12-20 Elias Eulig , Atalanti A. Mastakouri , Patrick Blöbaum , Michaela Hardt , Dominik Janzing

It is well known that non-parametric methods suffer from the "curse of dimensionality". We propose here a new estimation method for a multivariate distribution, using sub-sampling and ranks, which seems not to suffer from this "curse". We…

Statistics Theory · Mathematics 2013-11-08 Collet Jérôme

Consider a random geometric graph over a random point process in $\mathbb{R}^d$. Two points are connected by an edge if and only if their distance is bounded by a prescribed distance parameter. We show that projecting the graph onto a two…

Discrete Mathematics · Computer Science 2020-08-26 Markus Chimani , Hanna Döring , Matthias Reitzner

Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Yaohua Wang , FangYi Zhang , Ming Lin , Senzhang Wang , Xiuyu Sun , Rong Jin

In multivariate regression estimation, the rate of convergence depends on the dimension of the regressor. This fact, known as the curse of the dimensionality, motivated several works. The additive model, introduced by Stone (10), offers an…

Statistics Theory · Mathematics 2008-02-26 Mohammed Debbarh , Bertrand Maillot

We consider a random geometric graph with vertices sampled from a probability measure supported on $\mathbb R^d$, and study its connectivity. We show the graph is typically disconnected, unless the sampling density has superexponential…

Probability · Mathematics 2021-04-07 Henry-Louis de Kergorlay

We show that deep neural networks achieve dimension-independent rates of convergence for learning structured densities such as those arising in image, audio, video, and text applications. More precisely, we demonstrate that neural networks…

Machine Learning · Statistics 2024-11-25 Robert A. Vandermeulen , Wai Ming Tai , Bryon Aragam

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

Machine Learning · Computer Science 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

In this paper, we propose a perturbation framework to measure the robustness of graph properties. Although there are already perturbation methods proposed to tackle this problem, they are limited by the fact that the strength of the…

Social and Information Networks · Computer Science 2019-01-29 Yali Wan , Marina Meila

We prove that the gradient descent training of a two-layer neural network on empirical or population risk may not decrease population risk at an order faster than $t^{-4/(d-2)}$ under mean field scaling. Thus gradient descent training for…

Machine Learning · Computer Science 2020-05-22 Stephan Wojtowytsch , Weinan E

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv