English
Related papers

Related papers: Geometry-aware Bayesian Optimization in Robotics u…

200 papers

Bayesian Optimization (BO) is a data-driven strategy for minimizing/maximizing black-box functions based on probabilistic surrogate models. In the presence of safety constraints, the performance of BO crucially relies on tight probabilistic…

Machine Learning · Statistics 2025-04-15 Oleksii Molodchyk , Johannes Teutsch , Timm Faulwasser

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is…

Differential Geometry · Mathematics 2020-01-07 Florent Bouchard , Arnaud Breloy , Guillaume Ginolhac , Alexandre Renaux , Frédéric Pascal

In this paper we investigate and compare different gradient algorithms designed for the domain expression of the shape derivative. Our main focus is to examine the usefulness of kernel reproducing Hilbert spaces for PDE constrained shape…

Optimization and Control · Mathematics 2016-04-20 Martin Eigel , Kevin Sturm

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sample-inefficient and…

Machine Learning · Computer Science 2023-10-31 Xingchen Wan , Pierre Osselin , Henry Kenlay , Binxin Ru , Michael A. Osborne , Xiaowen Dong

In this thesis, I explore the possibilities of conducting Bayesian optimization techniques in high dimensional domains. Although high dimensional domains can be defined to be between hundreds and thousands of dimensions, we will primarily…

Machine Learning · Computer Science 2020-10-09 David Yenicelik

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Real world experiments are expensive, and thus it is important to reach a target in minimum number of experiments. Experimental processes often involve control variables that changes over time. Such problems can be formulated as a…

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

Constrained optimization plays a crucial role in the fields of quantum physics and quantum information science and becomes especially challenging for high-dimensional complex structure problems. One specific issue is that of quantum process…

Quantum Physics · Physics 2024-04-30 Daniel Volya , Andrey Nikitin , Prabhat Mishra

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Tree ensembles can be well-suited for black-box optimization tasks such as algorithm tuning and neural architecture search, as they achieve good predictive performance with little or no manual tuning, naturally handle discrete feature…

The generation of energy-efficient and dynamic-aware robot motions that satisfy constraints such as joint limits, self-collisions, and collisions with the environment remains a challenge. In this context, Riemannian geometry offers…

Robotics · Computer Science 2023-07-31 Holger Klein , Noémie Jaquier , Andre Meixner , Tamim Asfour

Computing optimal, collision-free trajectories for high-dimensional systems is a challenging problem. Sampling-based planners struggle with the dimensionality, whereas trajectory optimizers may get stuck in local minima due to inherent…

Robotics · Computer Science 2023-05-12 Thomas Cohn , Mark Petersen , Max Simchowitz , Russ Tedrake

Several tensor networks are built of isometric tensors, i.e. tensors satisfying $W^\dagger W = \mathrm{I}$. Prominent examples include matrix product states (MPS) in canonical form, the multiscale entanglement renormalization ansatz (MERA),…

Quantum Physics · Physics 2021-02-24 Markus Hauru , Maarten Van Damme , Jutho Haegeman

Covariance matrices have attracted attention for machine learning applications due to their capacity to capture interesting structure in the data. The main challenge is that one needs to take into account the particular geometry of the…

Machine Learning · Computer Science 2019-09-13 Daniel Brooks , Olivier Schwander , Frederic Barbaresco , Jean-Yves Schneider , Matthieu Cord

We propose a new Riemannian geometry for fixed-rank matrices that is specifically tailored to the low-rank matrix completion problem. Exploiting the degree of freedom of a quotient space, we tune the metric on our search space to the…

Machine Learning · Computer Science 2012-11-13 B. Mishra , K. Adithya Apuroop , R. Sepulchre

In engineering design, surrogate models are widely employed to replace computationally expensive simulations by leveraging design variables and geometric parameters from computer-aided design (CAD) models. However, these models often lose…

Machine Learning · Computer Science 2024-06-05 Jangseop Park , Namwoo Kang

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

This paper proposes and analyzes Riemannian optimization algorithms on the manifold of unitary and symmetric matrices, denoted ${\cal {U}}_s$, which naturally models the scattering matrices of passive and reciprocal devices such as…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Ignacio Santamaria , Carlos Beltrán , Eduard Jorswieck , Mohammad Soleymani , Jesus Gutiérrez