English
Related papers

Related papers: On a convergence property of a geometrical algorit…

200 papers

The convergence rate of stochastic gradient search is analyzed in this paper. Using arguments based on differential geometry and Lojasiewicz inequalities, tight bounds on the convergence rate of general stochastic gradient algorithms are…

Optimization and Control · Mathematics 2009-04-28 Vladislav B. Tadić

We present a simple geometric framework for the relational join. Using this framework, we design an algorithm that achieves the fractional hypertree-width bound, which generalizes classical and recent worst-case algorithmic results on…

Databases · Computer Science 2016-12-26 Mahmoud Abo Khamis , Hung Q. Ngo , Christopher Ré , Atri Rudra

In this paper, we evaluate the accuracy of deep learning approaches on geospatial vector geometry classification tasks. The purpose of this evaluation is to investigate the ability of deep learning models to learn from geometry coordinates…

Machine Learning · Statistics 2019-06-12 Rein van 't Veer , Peter Bloem , Erwin Folmer

We design and implement a Python library to help the non-expert using all these powerful tools in a way that is efficient, extensible, and simple to incorporate into the workflow of the data scientist, practitioner, and applied researcher.…

Optimization and Control · Mathematics 2022-04-13 Mario Lezcano-Casado

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

Recent developments in extreme value statistics have established the so-called geometric approach as a powerful modelling tool for multivariate extremes. We tailor these methods to the case of spatial modelling and examine their efficacy at…

Methodology · Statistics 2026-02-20 Lydia Kakampakou , Jennifer L. Wadsworth

Interesting data often concentrate on low dimensional smooth manifolds inside a high dimensional ambient space. Random projections are a simple, powerful tool for dimensionality reduction of such data. Previous works have studied bounds on…

Machine Learning · Statistics 2016-09-13 Subhaneil Lahiri , Peiran Gao , Surya Ganguli

Estimation procedures based on recursive algorithms are interesting and powerful techniques that are able to deal rapidly with (very) large samples of high dimensional data. The collected data may be contaminated by noise so that robust…

Statistics Theory · Mathematics 2015-01-29 Hervé Cardot , Peggy Cénac , Antoine Godichon

This paper presents a mathematical framework for analyzing machine learning models through the geometry of their induced partitions. By representing partitions as Riemannian simplicial complexes, we capture not only adjacency relationships…

Machine Learning · Computer Science 2025-08-05 Pawel Gajer , Jacques Ravel

We present a fast algorithm for global rigid symmetry detection with approximation guarantees. The algorithm is guaranteed to find the best approximate symmetry of a given shape, to within a user-specified threshold, with very high…

Computational Geometry · Computer Science 2016-09-20 Simon Korman , Roee Litman , Shai Avidan , Alex Bronstein

We prove the local convergence to minima and estimates on the rate of convergence for the stochastic gradient descent method in the case of not necessarily globally convex nor contracting objective functions. In particular, the results are…

Numerical Analysis · Mathematics 2021-11-02 Benjamin Fehrman , Benjamin Gess , Arnulf Jentzen

Modern statistical applications often involve minimizing an objective function that may be nonsmooth and/or nonconvex. This paper focuses on a broad Bregman-surrogate algorithm framework including the local linear approximation, mirror…

Optimization and Control · Mathematics 2021-12-20 Yiyuan She , Zhifeng Wang , Jiuwu Jin

When learning simulations for modeling physical phenomena in industrial designs, geometrical variabilities are of prime interest. While classical regression techniques prove effective for parameterized geometries, practical scenarios often…

Machine Learning · Computer Science 2023-10-24 Fabien Casenave , Brian Staber , Xavier Roynard

In this paper we develop new Newton and conjugate gradient algorithms on the Grassmann and Stiefel manifolds. These manifolds represent the constraints that arise in such areas as the symmetric eigenvalue problem, nonlinear eigenvalue…

Computational Physics · Physics 2009-09-25 Alan Edelman , T. A. Arias , Steven T. Smith

We introduce a novel diffusion-based spectral algorithm to tackle regression analysis on high-dimensional data, particularly data embedded within lower-dimensional manifolds. Traditional spectral algorithms often fall short in such…

Machine Learning · Statistics 2024-10-21 Weichun Xia , Jiaxin Jiang , Lei Shi

Very distinct strategies can be deployed to recognize and characterize an unknown environment or a shape. A recent and promising approach, especially in robotics, is to reduce the complexity of the exploratory units to a minimum. Here, we…

Robotics · Computer Science 2023-08-10 Samuel Hidalgo-Caballero , Alvaro Cassinelli , Emmanuel Fort , Matthieu Labousse

This paper considers a conceptual version of a convex optimization algorithm whic is based on replacing a convex optimization problem with the root-finding problem for the approximate sub-differential mapping which is solved by repeated…

Optimization and Control · Mathematics 2018-06-18 Evgeni Nurminski

We propose an extrinsic regression framework for modeling data with manifold valued responses and Euclidean predictors. Regression with manifold responses has wide applications in shape analysis, neuroscience, medical imaging and many other…

Statistics Theory · Mathematics 2015-08-11 Lizhen Lin , Brian St. Thomas , Hongtu Zhu , David B. Dunson

Stochastic gradient descent (SGD) and projected stochastic gradient descent (PSGD) are scalable algorithms to compute model parameters in unconstrained and constrained optimization problems. In comparison with SGD, PSGD forces its iterative…

Machine Learning · Statistics 2022-03-24 Ruiqi Liu , Mingao Yuan , Zuofeng Shang

We derive a numerical algorithm for evaluating the Riemannian logarithm on the Stiefel manifold with respect to the canonical metric. In contrast to the existing optimization-based approach, we work from a purely matrix-algebraic…

Numerical Analysis · Mathematics 2017-03-20 Ralf Zimmermann