English
Related papers

Related papers: High-order Accurate Inference on Manifolds

200 papers

For time series with high temporal correlation, the empirical process converges rather slowly to its limiting distribution. Many statistics in change-point analysis, goodness-of-fit testing and uncertainty quantification admit a…

Statistics Theory · Mathematics 2025-05-26 Annika Betken , Marie-Christine Düker

We propose a stochastic variance-reduced cubic regularized Newton algorithm to optimize the finite-sum problem over a Riemannian submanifold of the Euclidean space. The proposed algorithm requires a full gradient and Hessian update at the…

Optimization and Control · Mathematics 2022-12-14 Dewei Zhang , Sam Davanloo Tajbakhsh

Riemannian geometry provides the fundamental framework for optimization on nonlinear spaces such as matrix manifolds, which arise in machine learning, signal processing, and robotics. While the underlying theory is classical, existing…

Differential Geometry · Mathematics 2026-05-05 Benyamin Ghojogh

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic…

Methodology · Statistics 2022-08-19 Qian Zhao , Emmanuel J. Candes

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

Statistical inference for spatial processes from partially realized or scattered data has seen voluminous developments in diverse areas ranging from environmental sciences to business and economics. Inference on the associated rates of…

Statistics Theory · Mathematics 2026-01-06 Didong Li , Aritra Halder , Sudipto Banerjee

We introduce a Riemannian optimistic online learning algorithm for Hadamard manifolds based on inexact implicit updates. Unlike prior work, our method can handle in-manifold constraints, and matches the best known regret bounds in the…

Optimization and Control · Mathematics 2025-01-31 Christophe Roux , David Martínez-Rubio , Sebastian Pokutta

We reframe linear dimensionality reduction as a problem of Bayesian inference on matrix manifolds. This natural paradigm extends the Bayesian framework to dimensionality reduction tasks in higher dimensions with simpler models at greater…

Computation · Statistics 2016-06-15 Andrew Holbrook , Alexander Vandenberg-Rodes , Babak Shahbaba

We present Extended Riemannian Stochastic Derivative-Free Optimization (Extended RSDFO), a novel population-based stochastic optimization algorithm on Riemannian manifolds that addresses the locality and implicit assumptions of manifold…

Optimization and Control · Mathematics 2023-08-23 Robert Simon Fong , Peter Tino

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

This paper is concerned with estimation and inference for the location of a change point in the mean of independent high-dimensional data. Our change point location estimator maximizes a new U-statistic based objective function, and its…

Methodology · Statistics 2020-02-12 Runmin Wang , Xiaofeng Shao

Non-Euclidean constraints are inherent in many kinds of data in computer vision and machine learning, typically as a result of specific invariance requirements that need to be respected during high-level inference. Often, these geometric…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Suhas Lohit , Pavan Turaga

We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of representing many…

Machine Learning · Computer Science 2025-05-08 Philippe Chlenski , Quentin Chu , Itsik Pe'er

Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as…

Machine Learning · Statistics 2020-07-08 Daniel Ting , Michael I. Jordan

Neuroscience has recently made much progress, expanding the complexity of both neural-activity measurements and brain-computational models. However, we lack robust methods for connecting theory and experiment by evaluating our new big…

Quantitative Methods · Quantitative Biology 2023-07-06 Heiko H. Schütt , Alexander D. Kipnis , Jörn Diedrichsen , Nikolaus Kriegeskorte

A general approach to selective inference is considered for hypothesis testing of the null hypothesis represented as an arbitrary shaped region in the parameter space of multivariate normal model. This approach is useful for hierarchical…

Statistics Theory · Mathematics 2018-03-28 Yoshikazu Terada , Hidetoshi Shimodaira

Precision matrices play important roles in many practical applications. Motivated by temporally dependent multivariate data in modern social and scientific studies, we consider the statistical inference of precision matrices for…

Methodology · Statistics 2018-12-21 Jinyuan Chang , Yumou Qiu , Qiwei Yao , Tao Zou

This paper presents a perturbation analysis framework for nonsmooth optimization on connected Riemannian manifolds to bridge the gap between the rapid development of algorithmic approaches and a robust theoretical foundation. Using…

Optimization and Control · Mathematics 2025-10-01 Yuexin Zhou , Chao Ding , Yangjing Zhang

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

Riemannian diffusion models draw inspiration from standard Euclidean space diffusion models to learn distributions on general manifolds. Unfortunately, the additional geometric complexity renders the diffusion transition term inexpressible…

Machine Learning · Computer Science 2023-11-01 Aaron Lou , Minkai Xu , Stefano Ermon