English
Related papers

Related papers: Riemannian Optimization for Variance Estimation in…

200 papers

We introduce variational problems on Riemannian manifolds with constrained acceleration and derive necessary conditions for normal extremals in the constrained variational problem. The problem consists on minimizing a higher-order energy…

Optimization and Control · Mathematics 2022-02-25 Alexandre Anahory Simoes , Leonardo Colombo

We develop a multi-level restricted Gaussian maximum likelihood method for estimating the covariance function parameters and computing the best unbiased predictor. Our approach produces a new set of multi-level contrasts where the…

Computation · Statistics 2016-03-29 Julio E. Castrillon-Candas , Marc G. Genton , Rio Yokota

We extend the classical primal-dual interior point method from the Euclidean setting to the Riemannian one. Our method, named the Riemannian interior point method, is for solving Riemannian constrained optimization problems. We establish…

Optimization and Control · Mathematics 2024-03-06 Zhijian Lai , Akiko Yoshise

Given data, deep generative models, such as variational autoencoders (VAE) and generative adversarial networks (GAN), train a lower dimensional latent representation of the data space. The linear Euclidean geometry of data space pulls back…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Line Kuhnel , Tom Fletcher , Sarang Joshi , Stefan Sommer

In this paper, we derive a priori estimates for the gradient and second order derivatives of solutions to a class of Hessian type fully nonlinear parabolic equations with the first initial-boundary value problem on Riemannian manifolds.…

Analysis of PDEs · Mathematics 2015-02-04 Ge-Jun Bao , Wei-Song Dong

This paper considers the problem of computing Bayesian estimates of both states and model parameters for nonlinear state-space models. Generally, this problem does not have a tractable solution and approximations must be utilised. In this…

Machine Learning · Statistics 2020-12-15 Jarrad Courts , Johannes Hendriks , Adrian Wills , Thomas Schön , Brett Ninness

This paper proposes a general framework of Riemannian adaptive optimization methods. The framework encapsulates several stochastic optimization algorithms on Riemannian manifolds and incorporates the mini-batch strategy that is often used…

Optimization and Control · Mathematics 2025-02-14 Hiroyuki Sakai , Hideaki Iiduka

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

Recent literature has advocated the use of randomized methods for accelerating the solution of various matrix problems arising throughout data science and computational science. One popular strategy for leveraging randomization is to use it…

Numerical Analysis · Mathematics 2024-09-27 Boris Shustin , Haim Avron

(Neal and Hinton, 1998) recast maximum likelihood estimation of any given latent variable model as the minimization of a free energy functional $F$, and the EM algorithm as coordinate descent applied to $F$. Here, we explore alternative…

Computation · Statistics 2023-02-21 Juan Kuntz , Jen Ning Lim , Adam M. Johansen

In recent years, methods of approximate parameter estimation have attracted considerable interest in complex problems where exact likelihoods are hard to obtain. In their most basic form, Bayesian methods such as Approximate Bayesian…

Computation · Statistics 2015-07-17 Johanna Bertl , Gregory Ewing , Carolin Kosiol , Andreas Futschik

When classical particle filtering algorithms are used for maximum likelihood parameter estimation in nonlinear state-space models, a key challenge is that estimates of the likelihood function and its derivatives are inherently noisy. The…

Computation · Statistics 2017-11-30 Andreas Svensson , Fredrik Lindsten , Thomas B. Schön

Mixture modelling using elliptical distributions promises enhanced robustness, flexibility and stability over the widely employed Gaussian mixture model (GMM). However, existing studies based on the elliptical mixture model (EMM) are…

Machine Learning · Computer Science 2020-09-30 Shengxi Li , Zeyang Yu , Danilo Mandic

We consider linear mixed models in which the observations are grouped. A L1-penalization on the fixed effects coefficients of the log-likelihood obtained by considering the random effects as missing values is proposed. A multicycle ECM…

Computation · Statistics 2013-01-29 Florian Rohart , Magali San-Cristobal , Béatrice Laurent

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

Shape optimization based on the shape calculus is numerically mostly performed by means of steepest descent methods. This paper provides a novel framework to analyze shape-Newton optimization methods by exploiting a Riemannian perspective.…

Optimization and Control · Mathematics 2014-05-14 Volker Schulz

Manifold learning seeks a low dimensional representation that faithfully captures the essence of data. Current methods can successfully learn such representations, but do not provide a meaningful set of operations that are associated with…

Machine Learning · Computer Science 2019-08-21 David Eklund , Søren Hauberg

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

Machine Learning · Statistics 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

Variational quantum metrology represents a powerful tool for optimizing generic estimation strategies, combining the principles of variational optimization with the techniques of quantum metrology. Such optimization procedures result…