English
Related papers

Related papers: Advancing Mixture Models for Least Squares Optimiz…

200 papers

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

A key challenge in spatial statistics is the analysis for massive spatially-referenced data sets. Such analyses often proceed from Gaussian process specifications that can produce rich and robust inference, but involve dense covariance…

Methodology · Statistics 2019-07-25 Shinichiro Shirota , Andrew O. Finley , Bruce D. Cook , Sudipto Banerjee

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

This chapter surveys the most standard Monte Carlo methods available for simulating from a posterior distribution associated with a mixture and conducts some experiments about the robustness of the Gibbs sampler in high dimensional Gaussian…

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

Machine Learning · Computer Science 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

Generalized linear mixed models are useful in studying hierarchical data with possibly non-Gaussian responses. However, the intractability of likelihood functions poses challenges for estimation. We develop a new method suitable for this…

Methodology · Statistics 2022-01-26 Zexi Song , Zhiqiang Tan

We present a new subspace-based method to construct probabilistic models for high-dimensional data and highlight its use in anomaly detection. The approach is based on a statistical estimation of probability density using densities of…

Machine Learning · Computer Science 2021-08-16 Cetin Savkli , Catherine Schwartz

This paper proposes a novel uncertainty quantification framework for computationally demanding systems characterized by a large vector of non-Gaussian uncertainties. It combines state-of-the-art techniques in advanced Monte Carlo sampling…

Computation · Statistics 2018-03-05 Phaedon-Stelios Koutsourelakis

In robotic inspection of aviation parts, achieving accurate pairwise point cloud registration between scanned and model data is essential. However, noise and outliers generated in robotic scanned data can compromise registration accuracy.…

Robotics · Computer Science 2024-07-25 Lingjie Su , Wei Xu , Wenlong Li

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

The Method of Moments [Pea94] is one of the most widely used methods in statistics for parameter estimation, by means of solving the system of equations that match the population and estimated moments. However, in practice and especially…

Statistics Theory · Mathematics 2019-04-16 Yihong Wu , Pengkun Yang

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

A method is introduced for approximate marginal likelihood inference via adaptive Gaussian quadrature in mixed models with a single grouping factor. The core technical contribution is an algorithm for computing the exact gradient of the…

Methodology · Statistics 2024-11-13 Alex Stringer

This work considers the computation of risk measures for quantities of interest governed by PDEs with Gaussian random field parameters using Taylor approximations. While efficient, Taylor approximations are local to the point of expansion,…

Numerical Analysis · Mathematics 2024-08-14 Dingcheng Luo , Joshua Chen , Peng Chen , Omar Ghattas

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

For three decades, carrier-phase observations have been used to obtain the most accurate location estimates using global navigation satellite systems (GNSS). These estimates are computed by minimizing a nonlinear mixed-integer least-squares…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Ophir Uziel , Efi Fogel , Dan Halperin , Sivan Toledo

Introducing inequality constraints in Gaussian process (GP) models can lead to more realistic uncertainties in learning a great variety of real-world problems. We consider the finite-dimensional Gaussian approach from Maatouk and Bay (2017)…

Machine Learning · Statistics 2021-11-04 Andrés F. López-Lopera , François Bachoc , Nicolas Durrande , Olivier Roustant

Probabilistic 3D point cloud registration methods have shown competitive performance in overcoming noise, outliers, and density variations. However, registering point cloud pairs in the case of partial overlap is still a challenge. This…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Guofeng Mei , Fabio Poiesi , Cristiano Saltori , Jian Zhang , Elisa Ricci , Nicu Sebe

Item nonresponse is frequently encountered in practice. Ignoring missing data can lose efficiency and lead to misleading inference. Fractional imputation is a frequentist approach of imputation for handling missing data. However, the…

Methodology · Statistics 2018-09-18 Hejian Sang , Jae Kwang Kim
‹ Prev 1 3 4 5 6 7 10 Next ›