English
Related papers

Related papers: Optimization on Manifolds via Graph Gaussian Proce…

200 papers

The processing, storage and transmission of large-scale point clouds is an ongoing challenge in the computer vision community which hinders progress in the application of 3D models to real-world settings, such as autonomous driving, virtual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Stuti Pathak , Thomas M. McDonald , Seppe Sels , Rudi Penne

This paper develops manifold learning techniques for the numerical solution of PDE-constrained Bayesian inverse problems on manifolds with boundaries. We introduce graphical Mat\'ern-type Gaussian field priors that enable flexible modeling…

Numerical Analysis · Mathematics 2022-02-16 John Harlim , Shixiao Jiang , Hwanwoo Kim , Daniel Sanz-Alonso

Collecting operationally realistic data to inform machine learning models can be costly. Before collecting new data, it is helpful to understand where a model is deficient. For example, object detectors trained on images of rare objects may…

Machine Learning · Statistics 2025-12-24 Anna R. Flowers , Christopher T. Franck , Robert B. Gramacy , Justin A. Krometis

We propose a graph semi-supervised learning framework for classification tasks on data manifolds. Motivated by the manifold hypothesis, we model data as points sampled from a low-dimensional manifold $\mathcal{M} \subset \mathbb{R}^F$. The…

Machine Learning · Computer Science 2025-11-03 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

Bayesian learning with Gaussian processes demonstrates encouraging regression and classification performances in solving computer vision tasks. However, Bayesian methods on 3D manifold-valued vision data, such as meshes and point clouds,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yonghui Fan , Yalin Wang

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by…

Numerical Analysis · Mathematics 2020-08-26 Dimitris G. Giovanis , Michael D. Shields

A graph-based classification method is proposed for semi-supervised learning in the case of Euclidean data and for classification in the case of graph data. Our manifold learning technique is based on a convex optimization problem involving…

Machine Learning · Computer Science 2019-01-29 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian…

Methodology · Statistics 2018-10-30 Jize Zhang , Lizhen Lin

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

Machine Learning · Computer Science 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the…

Optimization and Control · Mathematics 2023-01-02 Yihao Fang , Mu Niu , Pokman Cheung , Lizhen Lin

The optimization of atomic structures plays a pivotal role in understanding and designing materials with desired properties. However, conventional computational methods often struggle with the formidable task of navigating the vast…

Materials Science · Physics 2024-11-19 Peder Lyngby , Casper Larsen , Karsten Wedel Jacobsen

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

Point cloud data are widely used in manufacturing applications for process inspection, modeling, monitoring and optimization. The state-of-art tensor regression techniques have effectively been used for analysis of structured point cloud…

Machine Learning · Computer Science 2023-04-03 Qian Wang , Kamran Paynabar

Building local surrogates to accelerate stationary point searches on potential energy surfaces spans decades of effort. Done correctly, surrogates can reduce the number of expensive electronic structure evaluations by roughly an order of…

Machine Learning · Statistics 2026-04-30 Rohit Goswami

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

We introduce a novel edge tracing algorithm using Gaussian process regression. Our edge-based segmentation algorithm models an edge of interest using Gaussian process regression and iteratively searches the image for edge pixels in a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Jamie Burke , Stuart King

We take a new look at parameter estimation for Gaussian Mixture Models (GMMs). In particular, we propose using \emph{Riemannian manifold optimization} as a powerful counterpart to Expectation Maximization (EM). An out-of-the-box invocation…

Machine Learning · Statistics 2015-06-26 Reshad Hosseini , Suvrit Sra

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso