English
Related papers

Related papers: Geometric Methods for Sampling, Optimisation, Infe…

200 papers

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian…

Optimization and Control · Mathematics 2025-02-28 Rashid A. , Amal A Samad

Efficient probabilistic inference by variable elimination in graphical models requires an optimal elimination order. However, finding an optimal order is a challenging combinatorial optimisation problem for models with a large number of…

Artificial Intelligence · Computer Science 2025-03-13 Sagad Hamid , Tanya Braun

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

Statistics Theory · Mathematics 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

Sampling is a fundamental problem in computer science and statistics. However, for a given task and stream, it is often not possible to choose good sampling probabilities in advance. We derive a general framework for adaptively changing the…

Machine Learning · Statistics 2022-06-16 Daniel Ting

A desirable property of an intelligent agent is its ability to understand its environment to quickly generalize to novel tasks and compose simpler tasks into more complex ones. If the environment has geometric or arithmetic structure, the…

Artificial Intelligence · Computer Science 2018-09-07 David Folqué , Sainbayar Sukhbaatar , Arthur Szlam , Joan Bruna

Symplectic integration of autonomous Hamiltonian systems is a well-known field of study in geometric numerical integration, but for non-autonomous systems the situation is less clear, since symplectic structure requires an even number of…

Numerical Analysis · Mathematics 2014-09-18 Håkon Marthinsen , Brynjulf Owren

Let $n$ be a positive integer. We provide an explicit geometrically motivated $1$-Lipschitz map from the space of persistence diagrams on $n$ points (equipped with the Bottleneck distance) into the Hilbert space $\ell^2$. Such maps are a…

Metric Geometry · Mathematics 2025-10-28 Atish Mitra , Ziga Virk

Hamiltonian systems of ordinary and partial differential equations are fundamental mathematical models spanning virtually all physical scales. A critical property for the robustness and stability of computational methods in such systems is…

Quantum Physics · Physics 2025-02-25 Hsuan-Cheng Wu , Xiantao Li

Researchers working with mathematical models are often confronted by the related problems of parameter estimation, model validation, and model selection. These are all optimization problems, well-known to be challenging due to…

Quantitative Methods · Quantitative Biology 2016-04-04 Elizabeth Gross , Brent Davis , Kenneth L. Ho , Daniel J. Bates , Heather A. Harrington

Much of the success of deep learning is drawn from building architectures that properly respect underlying symmetry and structure in the data on which they operate - a set of considerations that have been united under the banner of…

Machine Learning · Computer Science 2022-10-05 Matthew Spellings

Gradient descent methods and especially their stochastic variants have become highly popular in the last decade due to their efficiency on big data optimization problems. In this thesis we present the development of data sampling strategies…

Optimization and Control · Mathematics 2018-04-03 Dominik Csiba

While the construction of symplectic integrators for Hamiltonian dynamics is well understood, an analogous general theory for Poisson integrators is still lacking. The main challenge lies in overcoming the singular and non-linear geometric…

Numerical Analysis · Mathematics 2024-09-09 Alejandro Cabrera , David Martín de Diego , Miguel Vaquero

In the framework of generalized finite element methods for elliptic equations with rough coefficients, efficiency and accuracy of the numerical method depend critically on the use of appropriate basis functions. This work explores several…

Optimization and Control · Mathematics 2018-12-20 Ke Chen , Qin Li , Jianfeng Lu , Stephen J. Wright

Convex regression is a promising area for bridging statistical estimation and deterministic convex optimization. New piecewise linear convex regression methods are fast and scalable, but can have instability when used to approximate…

Machine Learning · Computer Science 2012-06-22 Lauren Hannah , David Dunson

This paper presents a sampling-based motion planning framework that leverages the geometry of obstacles in a workspace as well as prior experiences from motion planning problems. Previous studies have demonstrated the benefits of utilizing…

Robotics · Computer Science 2023-06-19 Keita Kobashi , Changhao Wang , Yu Zhao , Hsien-Chung Lin , Masayoshi Tomizuka

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

Optimization and Control · Mathematics 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

Recovering point clouds involves the sequential process of sampling and restoration, yet existing methods struggle to effectively leverage both topological and geometric attributes. To address this, we propose an end-to-end architecture…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaiyue Zhou , Zelong Tan , Hongxiao Wang , Ya-Li Li , Shengjin Wang

Removing geometrical details from a complex domain is a classical operation in computer aided design. This procedure simplifies the meshing process, and it enables faster simulations with less memory requirements. However, depending on the…

Numerical Analysis · Mathematics 2024-07-18 Annalisa Buffa , Ondine Chanon , Rafael Vázquez

We approach the well-studied problem of supervised group invariant and equivariant machine learning from the point of view of geometric topology. We propose a novel approach using a pre-processing step, which involves projecting the input…

Machine Learning · Computer Science 2022-02-07 Benjamin Aslan , Daniel Platt , David Sheard