English
Related papers

Related papers: Multivariate Regression Depth

200 papers

Depth notions in regression have been systematically proposed and examined in Zuo (2018). One of the prominent advantages of notion of depth is that it can be directly utilized to introduce median-type deepest estimating functionals (or…

Statistics Theory · Mathematics 2019-08-13 Yijun Zuo

Based on the tree architecture, the objective of this paper is to design deep neural networks with two or more hidden layers (called deep nets) for realization of radial functions so as to enable rotational invariance for near-optimal…

Machine Learning · Computer Science 2019-04-04 Charles K. Chui , Shao-Bo Lin , Ding-Xuan Zhou

We consider semi-supervised regression when the predictor variables are drawn from an unknown manifold. A simple two step approach to this problem is to: (i) estimate the manifold geodesic distance between any pair of points using both the…

Machine Learning · Statistics 2019-09-16 Amit Moscovich , Ariel Jaffe , Boaz Nadler

Let $P$ be a set of $n$ points in $d$-dimensions. The simplicial depth, $\sigma_P(q)$ of a point $q$ is the number of $d$-simplices with vertices in $P$ that contain $q$ in their convex hulls. The simplicial depth is a notion of data depth…

Computational Geometry · Computer Science 2015-12-29 Peyman Afshani , Donald R. Sheehy , Yannik Stein

Many man-made objects are characterised by a shape that is symmetric along one or more planar directions. Estimating the location and orientation of such symmetry planes can aid many tasks such as estimating the overall orientation of an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Mihaela Cătălina Stoian , Tommaso Cavallari

Consider a non-negative number $t$ and a hyperplane $H$ of $\mathbb{R}^d$ whose distance to the center of the hypercube $[0,1]^d$ is $t$. If $t$ is equal to $0$ and $H$ is orthogonal to a diagonal of $[0,1]^d$, it is known that the…

Metric Geometry · Mathematics 2025-03-05 Lionel Pournin

We will show that for any $n\ge N$ points on the $N$-dimensional sphere $S^N$ there is a closed hemisphere which contains at least $\lfloor\frac{n+N+1}{2}\rfloor$ of these points. This bound is sharp and we will calculate the amount of sets…

Metric Geometry · Mathematics 2007-05-23 Jan Fricke

Despite their empirical success, pushing Transformer architectures to extreme depth often leads to a paradoxical failure: representations become increasingly redundant, lose rank, and ultimately collapse. Existing explanations largely…

Machine Learning · Computer Science 2026-01-16 Haoran Su , Chenyu You

For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous nonsmooth theory is challenging. Even when the objective is…

Optimization and Control · Mathematics 2023-01-19 X. Y. Han , Adrian S. Lewis

Depth is a concept that measures the `centrality' of a point in a given data cloud or in a given probability distribution. Every depth defines a family of so-called trimmed regions. For statistical applications it is desirable that with…

Statistics Theory · Mathematics 2017-04-13 Rainer Dyckerhoff

Consider a regression problem where the learner is given a large collection of $d$-dimensional data points, but can only query a small subset of the real-valued labels. How many queries are needed to obtain a $1+\epsilon$ relative error…

Machine Learning · Computer Science 2021-06-29 Xue Chen , Michał Dereziński

This paper studies how to generalize Tukey's depth to problems defined in a restricted space that may be curved or have boundaries, and to problems with a nondifferentiable objective. First, using a manifold approach, we propose a broad…

Methodology · Statistics 2023-05-05 Yiyuan She , Shao Tang , Jingze Liu

We revisit the HED Method for the Mullins-Sekerka evolution in the plane. We identify a natural notion of distance, intrinsic to the interface itself. Using this distance, the energy, and the dissipation, we develop natural assumptions on…

Analysis of PDEs · Mathematics 2026-03-10 Wenhui Shi , Maria G. Westdickenberg , Michael Westdickenberg

We study exact Lagrangian immersions with one double point of a closed orientable manifold K into n-complex-dimensional Euclidean space. Our main result is that if the Maslov grading of the double point does not equal 1 then K is homotopy…

Symplectic Geometry · Mathematics 2013-07-17 Tobias Ekholm , Ivan Smith

Data depth is a statistical function that generalizes order and quantiles to the multivariate setting and beyond, with applications spanning over descriptive and visual statistics, anomaly detection, testing, etc. The celebrated halfspace…

Machine Learning · Statistics 2023-12-22 Arturo Castellanos , Pavlo Mozharovskyi , Florence d'Alché-Buc , Hicham Janati

Multiple near frontal-parallel planes based depth representation demonstrated impressive results in self-supervised monocular depth estimation (MDE). Whereas, such a representation would cause the discontinuity of the ground as it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Ruoyu Wang , Zehao Yu , Shenghua Gao

Exploiting the variational interpretation of kernel interpolation we exhibit a direct connection between interpolation and regression, where interpolation appears as a limiting case of regression. By applying this framework to point clouds…

Numerical Analysis · Mathematics 2026-02-09 Patrick Guidotti

Let $K\subseteq{\mathbb R}^n$ be a convex semialgebraic set. The semidefinite extension degree ${\mathrm{sxdeg}}(K)$ of $K$ is the smallest number $d$ such that $K$ is a linear image of an intersection of finitely many spectrahedra, each of…

Algebraic Geometry · Mathematics 2024-10-15 Claus Scheiderer

The well-known Reifenberg theorem states that if a subset of $\mathbb{R}^n$ can be well approximated by $k$-planes at every point and every scale, then it is biH\"older homeomorphic to a $k$-disk. This article concerns a subset $S$ of…

Metric Geometry · Mathematics 2025-08-21 Jiaqi Zang

We consider the regression problem of estimating functions on $\mathbb{R}^D$ but supported on a $d$-dimensional manifold $ \mathcal{M} \subset \mathbb{R}^D $ with $ d \ll D $. Drawing ideas from multi-resolution analysis and nonlinear…

Machine Learning · Statistics 2021-01-14 Wenjing Liao , Mauro Maggioni , Stefano Vigogna