English
Related papers

Related papers: On a convergence property of a geometrical algorit…

200 papers

We approach the well-studied problem of supervised group invariant and equivariant machine learning from the point of view of geometric topology. We propose a novel approach using a pre-processing step, which involves projecting the input…

Machine Learning · Computer Science 2022-02-07 Benjamin Aslan , Daniel Platt , David Sheard

In this chapter, we identify fundamental geometric structures that underlie the problems of sampling, optimisation, inference and adaptive decision-making. Based on this identification, we derive algorithms that exploit these geometric…

A tutorial introduction to projective geometric algebra (PGA), a modern, coordinate-free framework for doing euclidean geometry. PGA features: uniform representation of points, lines, and planes; robust, parallel-safe join and meet…

General Mathematics · Mathematics 2020-08-19 Charles G. Gunn

Motivated by a wide variety of applications, ranging from stochastic optimization to dimension reduction through variable selection, the problem of estimating gradients accurately is of crucial importance in statistics and learning theory.…

Machine Learning · Computer Science 2020-06-29 Guillaume Ausset , Stephan Clémençon , François Portier

A general class of Newton algorithms on Gra{\ss}mann and Lagrange-Gra{\ss}mann manifolds is introduced, that depends on an arbitrary pair of local coordinates. Local quadratic convergence of the algorithm is shown under a suitable condition…

Optimization and Control · Mathematics 2011-11-10 Uwe Helmke , Knut Hüper , Jochen Trumpf

Several recent works have explored stochastic gradient methods for variational inference that exploit the geometry of the variational-parameter space. However, the theoretical properties of these methods are not well-understood and these…

Machine Learning · Statistics 2016-08-15 Mohammad Emtiyaz Khan , Reza Babanezhad , Wu Lin , Mark Schmidt , Masashi Sugiyama

We study computing geometric problems on uncertain points. An uncertain point is a point that does not have a fixed location, but rather is described by a probability distribution. When these probability distributions are restricted to a…

Computational Geometry · Computer Science 2012-05-03 Allan Jorgensen , Maarten Löffler , Jeff M. Phillips

A recursive estimator of the conditional geometric median in Hilbert spaces is studied. It is based on a stochastic gradient algorithm whose aim is to minimize a weighted L1 criterion and is consequently well adapted for robust online…

Statistics Theory · Mathematics 2012-04-18 Hervé Cardot , Peggy Cénac , Pierre-André Zitt

Nonparametric estimation of a mixing density based on observations from the corresponding mixture is a challenging statistical problem. This paper surveys the literature on a fast, recursive estimator based on the predictive recursion…

Methodology · Statistics 2022-09-15 Ryan Martin

In this paper we discuss various connections between geometric discrepancy measures, such as discrepancy with respect to convex sets (and convex sets with smooth boundary in particular), and applications to numerical analysis and…

Numerical Analysis · Mathematics 2013-11-18 Josef Dick

We consider the problem of estimating the support of a measure from a finite, independent, sample. The estimators which are considered are constructed based on the empirical Christoffel function. Such estimators have been proposed for the…

Statistics Theory · Mathematics 2020-05-20 Mai Trang Vu , François Bachoc , Edouard Pauwels

Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for…

Statistics Theory · Mathematics 2017-10-17 Antoine Godichon-Baggioni

In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function $f(x)$, obtained from stochastic…

Optimization and Control · Mathematics 2016-09-26 Ruobing Chen , Matt Menickelly , Katya Scheinberg

We present a study on connection errors in networks of linear features and methods of error detection. We model networks with special connection specifications as networks with hierarchically connected features and define errors considering…

Data Structures and Algorithms · Computer Science 2015-04-07 Panteleimon Rodis

We consider the following general scheduling problem: The input consists of n jobs, each with an arbitrary release time, size, and a monotone function specifying the cost incurred when the job is completed at a particular time. The…

Data Structures and Algorithms · Computer Science 2010-08-31 Nikhil Bansal , Kirk Pruhs

We study the approximate nearest neighbour method for cost-sensitive classification on low-dimensional manifolds embedded within a high-dimensional feature space. We determine the minimax learning rates for distributions on a smooth…

Machine Learning · Computer Science 2018-03-02 Henry WJ Reeve , Gavin Brown

Learning-to-optimize leverages machine learning to accelerate optimization algorithms. While empirical results show tremendous improvements compared to classical optimization algorithms, theoretical guarantees are mostly lacking, such that…

Machine Learning · Computer Science 2025-06-02 Michael Sucker , Peter Ochs

This tutorial provides an exposition of a flexible geometric framework for high dimensional estimation problems with constraints. The tutorial develops geometric intuition about high dimensional sets, justifies it with some results of…

Statistics Theory · Mathematics 2016-12-23 Roman Vershynin

In this paper, we define the geometric median of a probability measure on a Riemannian manifold, give its characterization and a natural condition to ensure its uniqueness. In order to calculate the median in practical cases, we also…

Differential Geometry · Mathematics 2019-02-20 Le Yang

We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may…

Optimization and Control · Mathematics 2023-12-25 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa