English
Related papers

Related papers: Estimation in high dimensions: a geometric perspec…

200 papers

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

We investigate robust optimization problems defined for maximizing convex functions. For finite uncertainty set, we develop a geometric branch-and-bound algorithmic approach to solve this problem. The geometric branch-and-bound algorithm…

Optimization and Control · Mathematics 2019-11-21 Fengqiao Luo , Sanjay Mehrotra

High dimensional superposition models characterize observations using parameters which can be written as a sum of multiple component parameters, each with its own structure, e.g., sum of low rank and sparse matrices, sum of sparse and…

Machine Learning · Computer Science 2017-06-01 Qilong Gu , Arindam Banerjee

Sketching is used as a ubiquitous tool of expression by novices and experts alike. In this thesis I explore two methods that help a system provide a geometric machine-understanding of sketches, and in-turn help a user accomplish a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Raghav Brahmadesam Venkataramaiyer

A novel approach is introduced to a very widely occurring problem, providing a complete, explicit resolution of it: minimisation of a convex quadratic under a general quadratic, equality or inequality, constraint. Completeness comes via…

Optimization and Control · Mathematics 2017-07-21 Casper Albers , Frank Critchley , John Gower

A brief introduction to geometric valuation theory is given. The focus is on classification results for valuations on convex bodies and on function spaces.

Metric Geometry · Mathematics 2024-04-09 Monika Ludwig

We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived…

Machine Learning · Statistics 2025-03-11 Gilles Blanchard , Jean-Baptiste Fermanian , Hannah Marienwald

The study of geometric extremes, where extremal dependence properties are inferred from the deterministic limiting shapes of scaled sample clouds, provides an exciting approach to modelling the extremes of multivariate data. These shapes,…

Methodology · Statistics 2024-09-16 Callum J. R. Murphy-Barltrop , Reetam Majumder , Jordan Richards

Delay embedding---a method for reconstructing dynamical systems by delay coordinates---is widely used to forecast nonlinear time series as a model-free approach. When multivariate time series are observed, several existing frameworks can be…

Machine Learning · Statistics 2019-07-04 Shunya Okuno , Kazuyuki Aihara , Yoshito Hirata

Deep Neural Networks achieve state-of-the-art results in many different problem settings by exploiting vast amounts of training data. However, collecting, storing and - in the case of supervised learning - labelling the data is expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

Many quantities we are interested in predicting are geometric tensors; we refer to this class of problems as geometric prediction. Attempts to perform geometric prediction in real-world scenarios have been limited to approximating them…

Machine Learning · Computer Science 2020-06-26 Raphael J. L. Townshend , Brent Townshend , Stephan Eismann , Ron O. Dror

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

Consider measuring an n-dimensional vector x through the inner product with several measurement vectors, a_1, a_2, ..., a_m. It is common in both signal processing and statistics to assume the linear response model y_i = <a_i, x> + e_i,…

Probability · Mathematics 2016-05-20 Yaniv Plan , Roman Vershynin , Elena Yudovina

Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence…

Optimization and Control · Mathematics 2020-02-25 Johannes O. Royset

We present a geometric multilevel optimization approach that smoothly incorporates box constraints. Given a box constrained optimization problem, we consider a hierarchy of models with varying discretization levels. Finer models are…

Optimization and Control · Mathematics 2024-04-23 Sebastian Müller , Stefania Petra , Matthias Zisler

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

In Mathematics is common to make a mistake and therefore a false conclusion arises. In each case it is important to recognize the mistake in order to avoid a similar one in the future. Geometric figures provide decisive help in order to…

History and Overview · Mathematics 2023-10-20 Protopapas Eleftherios

A convex optimization model predicts an output from an input by solving a convex optimization problem. The class of convex optimization models is large, and includes as special cases many well-known models like linear and logistic…

Machine Learning · Computer Science 2020-06-19 Akshay Agrawal , Shane Barratt , Stephen Boyd

Text documents are complex high dimensional objects. To effectively visualize such data it is important to reduce its dimensionality and visualize the low dimensional embedding as a 2-D or 3-D scatter plot. In this paper we explore…

Computation and Language · Computer Science 2010-03-03 Yi Mao , Krishnakumar Balasubramanian , Guy Lebanon