English
Related papers

Related papers: Optimal Reach Estimation and Metric Learning

200 papers

We propose a randomized algorithm with query access that given a graph $G$ with arboricity $\alpha$, and average degree $d$, makes $\widetilde{O}\left(\frac{\alpha}{\varepsilon^2d}\right)$ \texttt{Degree} and…

Data Structures and Algorithms · Computer Science 2025-11-06 Debarshi Chanda

We consider 1-dimensional location estimation, where we estimate a parameter $\lambda$ from $n$ samples $\lambda + \eta_i$, with each $\eta_i$ drawn i.i.d. from a known distribution $f$. For fixed $f$ the maximum-likelihood estimate (MLE)…

Statistics Theory · Mathematics 2022-07-20 Shivam Gupta , Jasper C. H. Lee , Eric Price , Paul Valiant

We study kernel estimation of highest-density regions (HDR). Our main contributions are two-fold. First, we derive a uniform-in-bandwidth asymptotic approximation to a risk that is appropriate for HDR estimation. This approximation is then…

Statistics Theory · Mathematics 2010-10-05 R. J. Samworth , M. P. Wand

Consensus algorithms are popular distributed algorithms for computing aggregate quantities, such as averages, in ad-hoc wireless networks. However, existing algorithms mostly address the case where the measurements lie in a Euclidean space.…

Dynamical Systems · Mathematics 2012-02-02 Roberto Tron , Bijan Afsari , René Vidal

While classical data analysis has addressed observations that are real numbers or elements of a real vector space, at present many statistical problems of high interest in the sciences address the analysis of data that consist of more…

Statistics Theory · Mathematics 2023-08-15 Zhigang Yao , Jiaji Su , Bingjie Li , Shing-Tung Yau

Many machine learning algorithms used for dimensional reduction and manifold learning leverage on the computation of the nearest neighbours to each point of a dataset to perform their tasks. These proximity relations define a so-called…

Statistical Mechanics · Physics 2020-07-22 Vittorio Erba , Sebastiano Ariosto , Marco Gherardi , Pietro Rotondo

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

We propose a generative model that achieves minimax-optimal convergence rates for estimating probability distributions supported on unknown low-dimensional manifolds. Building on Fefferman's solution to the geometric Whitney problem, our…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

We introduce the concept of shape-regular regression maps as a framework to derive optimal rates of convergence for various non-parametric local regression estimators. Using Vapnik-Chervonenkis theory, we establish upper and lower bounds on…

Statistics Theory · Mathematics 2025-01-31 Jérémy Bettinger , François Portier , Adrien Saumard

An algorithm observes the trajectories of random walks over an unknown graph $G$, starting from the same vertex $x$, as well as the degrees along the trajectories. For all finite connected graphs, one can estimate the number of edges $m$ up…

Statistics Theory · Mathematics 2018-08-20 Anna Ben-Hamou , Roberto I. Oliveira , Yuval Peres

Large learning rates, when applied to gradient descent for nonconvex optimization, yield various implicit biases including the edge of stability (Cohen et al., 2021), balancing (Wang et al., 2022), and catapult (Lewkowycz et al., 2020).…

Machine Learning · Computer Science 2023-12-13 Yuqing Wang , Zhenghao Xu , Tuo Zhao , Molei Tao

Based on a quantitative version of the inverse function theorem and an appropriate saddle-point formulation we derive a quasi-optimal error estimate for the finite element approximation of harmonic maps into spheres with a nodal…

Numerical Analysis · Mathematics 2022-09-27 Sören Bartels , Christian Palus , Zhangxian Wang

Manifold optimization is ubiquitous in computational and applied mathematics, statistics, engineering, machine learning, physics, chemistry and etc. One of the main challenges usually is the non-convexity of the manifold constraints. By…

Optimization and Control · Mathematics 2019-06-14 Jiang Hu , Xin Liu , Zaiwen Wen , Yaxiang Yuan

In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator…

Statistics Theory · Mathematics 2021-06-04 Alden Green , Sivaraman Balakrishnan , Ryan J. Tibshirani

In this paper, we examine a geometrical projection algorithm for statistical inference. The algorithm is based on Pythagorean relation and it is derivative-free as well as representation-free that is useful in nonparametric cases. We derive…

Machine Learning · Computer Science 2019-09-30 Shotaro Akaho , Hideitsu Hino , Noboru Murata

We geometrically analyze the problem of estimating parameters related to the shape and size of a two-dimensional target object on the plane by using randomly distributed distance sensors whose locations are unknown. Based on the analysis…

Information Theory · Computer Science 2017-07-20 Hiroshi Saito , Hirotada Honda

Learning is a fundamental characteristic of living systems, enabling them to comprehend their environments and make informed decisions. These decision-making processes are inherently influenced by available information about their…

Disordered Systems and Neural Networks · Physics 2025-04-21 Arnab Barua , Haralampos Hatzikirou , Sumiyoshi Abe

This paper proposes a novel paradigm for machine learning that moves beyond traditional parameter optimization. Unlike conventional approaches that search for optimal parameters within a fixed geometric space, our core idea is to treat the…

Machine Learning · Computer Science 2025-10-31 Di Zhang

Quantum parameter estimation holds the promise of quantum technologies, in which physical parameters can be measured with much greater precision than what is achieved with classical technologies. However, how to obtain a best precision when…

Quantum Physics · Physics 2024-03-05 Jianning Li , Dianzhen Cui , X. X. Yi

We review recent work on the local geometry and optimal regularity of Lorentzian manifolds with bounded curvature. Our main results provide an estimate of the injectivity radius of an observer, and a local canonical foliations by CMC…

General Relativity and Quantum Cosmology · Physics 2008-12-20 Philippe G. LeFloch