English
Related papers

Related papers: Scalable Extreme Deconvolution

200 papers

We propose a scalable stochastic variational approach to GP classification building on Polya-Gamma data augmentation and inducing points. Unlike former approaches, we obtain closed-form updates based on natural gradients that lead to…

Machine Learning · Statistics 2018-11-28 Florian Wenzel , Theo Galy-Fajou , Christan Donner , Marius Kloft , Manfred Opper

This study explores the classification error of Mixture Discriminant Analysis (MDA) in scenarios where the number of mixture components exceeds those present in the actual data distribution, a condition known as overspecification. We use a…

Machine Learning · Statistics 2025-11-03 Arman Bolatov , Alan Legg , Igor Melnykov , Amantay Nurlanuly , Maxat Tezekbayev , Zhenisbek Assylbekov

Graphical models with change-points are computationally challenging to fit, particularly in cases where the number of observation points and the number of nodes in the graph are large. Focusing on Gaussian graphical models, we introduce an…

Methodology · Statistics 2017-07-17 Yves Atchade , Leland Bybee

Wearable electrocardiogram (ECG) measurement using dry electrodes has a problem with high-intensity noise distortion. Hence, a robust noise reduction method is required. However, overlapping frequency bands of ECG and noise make noise…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Takamasa Terada , Masahiro Toyoura

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

We present a new deep learning-based approach for dense stereo matching. Compared to previous works, our approach does not use deep learning of pixel appearance descriptors, employing very fast classical matching scores instead. At the same…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Andrey Kuzmin , Dmitry Mikushin , Victor Lempitsky

Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, we propose a novel, robust maximum entropy algorithm, which is capable of dealing with hundreds of moments and allows for computationally…

Machine Learning · Statistics 2019-06-05 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Doing , Michael Osborne , Stephen Roberts

Energy-Based Models (EBMs) assign unnormalized log-probability to data samples. This functionality has a variety of applications, such as sample synthesis, data denoising, sample restoration, outlier detection, Bayesian reasoning, and many…

Machine Learning · Statistics 2019-12-23 Zengyi Li , Yubei Chen , Friedrich T. Sommer

We propose a deconvolution algorithm for images blurred and degraded by a Poisson noise. The algorithm uses a fast proximal backward-forward splitting iteration. This iteration minimizes an energy which combines a \textit{non-linear} data…

Applications · Statistics 2008-12-18 François-Xavier Dupé , Jalal Fadili , Jean Luc Starck

Let us consider the deconvolution problem, that is, to recover a latent source $x(\cdot)$ from the observations $\mathbf{y} = [y_1,\ldots,y_N]$ of a convolution process $y = x\star h + \eta$, where $\eta$ is an additive noise, the…

Machine Learning · Statistics 2023-07-19 Felipe Tobar , Arnaud Robert , Jorge F. Silva

Removing the aberrations introduced by the Point Spread Function (PSF) is a fundamental aspect of astronomical image processing. The presence of noise in observed images makes deconvolution a nontrivial task that necessitates the use of…

Instrumentation and Methods for Astrophysics · Physics 2017-05-03 Samuel Farrens , Jean-Luc Starck , Fred Maurice Ngolè Mboula

Conventional approaches to cosmology inference from galaxy redshift surveys are based on n-point functions, which are under rigorous perturbative control on sufficiently large scales. Here, we present an alternative approach, which employs…

Cosmology and Nongalactic Astrophysics · Physics 2019-01-23 Fabian Schmidt , Franz Elsner , Jens Jasche , Nhat Minh Nguyen , Guilhem Lavaux

We consider model-based clustering methods for continuous, correlated data that account for external information available in the presence of mixed-type fixed covariates by proposing the MoEClust suite of models. These models allow…

Methodology · Statistics 2021-07-15 Keefe Murphy , Thomas Brendan Murphy

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

Spectroscopy represents the ideal observational method to maximally extract information from galaxies regarding their star formation and chemical enrichment histories. However, absorption spectra of galaxies prove rather challenging at high…

Instrumentation and Methods for Astrophysics · Physics 2025-10-10 Oliver Camilleri , Zahra Sharbaf , Ignacio Ferreras

Machine learning has become a popular tool to help us make better decisions and predictions, based on experiences, observations and analysing patterns within a given data set without explicitly functions. In this paper, we describe an…

Solar and Stellar Astrophysics · Physics 2020-02-19 Yu Bai , JiFeng Liu , YiLun Wang , Song Wang

Using gradient descent (GD) with fixed or decaying step-size is a standard practice in unconstrained optimization problems. However, when the loss function is only locally convex, such a step-size schedule artificially slows GD down as it…

Machine Learning · Statistics 2023-02-03 Nhat Ho , Tongzheng Ren , Sujay Sanghavi , Purnamrita Sarkar , Rachel Ward

Data mining techniques, including clustering and classification tasks, for the automatic information extraction from large datasets are increasingly demanded in several scientific fields. In particular, in the astrophysical field, large…

Astrophysics · Physics 2015-06-24 M. Frailis , A. De Angelis , V. Roberto

This paper proposes a stochastic gradient descent method with an adaptive Gaussian noise term for the global minimization of nearly convex functions, which are nonconvex and possess multiple strict local minimizers. The noise term,…

Optimization and Control · Mathematics 2025-08-05 Chenglong Bao , Liang Chen , Weizhi Shao

Matrix decomposition is one of the fundamental tools to discover knowledge from big data generated by modern applications. However, it is still inefficient or infeasible to process very big data using such a method in a single machine.…

Machine Learning · Computer Science 2020-02-11 Chihao Zhang , Yang Yang , Wei Zhang , Shihua Zhang