English
Related papers

Related papers: A data driven equivariant approach to constrained …

200 papers

One goal in Bayesian machine learning is to encode prior knowledge into prior distributions, to model data efficiently. We consider prior knowledge from systems of linear partial differential equations together with their boundary…

Machine Learning · Computer Science 2021-02-16 Markus Lange-Hegermann

Gaussian mixtures are a powerful and widely used tool to model non-Gaussian estimation problems. They are able to describe measurement errors that follow arbitrary distributions and can represent ambiguity in assignment tasks like point set…

Robotics · Computer Science 2021-04-02 Tim Pfeifer , Sven Lange , Peter Protzel

A method is presented to solve a stochastic, nonlinear optimal control problem representative of spacecraft trajectory design under uncertainty. The problem is reformulated as a chance constrained nonlinear program, or what is known as a…

Optimization and Control · Mathematics 2024-01-05 William Fife , Pradipto Ghosh , Kyle DeMars

Non-Gaussian likelihoods are essential for modelling complex real-world observations but pose significant computational challenges in learning and inference. Even with Gaussian priors, non-Gaussian likelihoods often lead to analytically…

Machine Learning · Statistics 2024-10-29 Thang D. Bui

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

Machine Learning · Computer Science 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein

Distributionally robust chance constrained programs minimize a deterministic cost function subject to the satisfaction of one or more safety conditions with high probability, given that the probability distribution of the uncertain problem…

Optimization and Control · Mathematics 2022-11-22 Zhi Chen , Daniel Kuhn , Wolfram Wiesemann

We study parameter estimation in linear Gaussian covariance models, which are $p$-dimensional Gaussian models with linear constraints on the covariance matrix. Maximum likelihood estimation for this class of models leads to a non-convex…

Statistics Theory · Mathematics 2016-04-19 Piotr Zwiernik , Caroline Uhler , Donald Richards

Binomial data with unknown sizes often appear in biological and medical sciences and are usually overdispersed. All previous methods used parametric models and only considered overdispersion due to the variation of sizes. The proposed…

Statistics Theory · Mathematics 2007-06-13 Wei Zhang

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

We propose a data-driven way to reduce the noise of covariance matrices of nonstationary systems. In the case of stationary systems, asymptotic approaches were proved to converge to the optimal solutions. Such methods produce eigenvalues…

Applications · Statistics 2023-03-10 Christian Bongiorno , Damien Challet , Grégoire Loeper

We develop a factor analysis for mixed continuous and binary observed variables. To this end, we utilized a recently developed multivariate probability distribution for mixed-type random variables, the Gaussian-Grassmann distribution. In…

Methodology · Statistics 2025-12-12 Takashi Arai

We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac…

Machine Learning · Statistics 2025-04-03 Daniel Frisch , Uwe D. Hanebeck

Achieving covariate balance in randomized experiments enhances the precision of treatment effect estimation. However, existing methods often require heuristic adjustments based on domain knowledge and are primarily developed for binary…

Methodology · Statistics 2025-02-25 Wenxuan Guo , Tengyuan Liang , Panos Toulis

In this paper, we develop an exact reformulation and a deterministic approximation for distributionally robust joint chance-constrained programmings (DRCCPs) with a general class of convex uncertain constraints under data-driven Wasserstein…

Optimization and Control · Mathematics 2022-09-07 Yining Gu , Yanjun Wang

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs) on $\mathbb{R}^d$ of the form $P= \sum_{i=1}^k w_i…

Machine Learning · Computer Science 2023-06-23 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

Missing values with mixed data types is a common problem in a large number of machine learning applications such as processing of surveys and in different medical applications. Recently, Gaussian copula models have been suggested as a means…

Machine Learning · Statistics 2021-07-02 Benjamin Christoffersen , Mark Clements , Keith Humphreys , Hedvig Kjellström

We explore computational aspects of maximum likelihood estimation of the mixture proportions of a nonparametric finite mixture model -- a convex optimization problem with old roots in statistics and a key member of the modern data analysis…

Computation · Statistics 2023-12-11 Haoyue Wang , Shibal Ibrahim , Rahul Mazumder

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari