English
Related papers

Related papers: Stochastic EM methods with Variance Reduction for …

200 papers

Fast Incremental Expectation Maximization (FIEM) is a version of the EM framework for large datasets. In this paper, we first recast FIEM and other incremental EM type algorithms in the {\em Stochastic Approximation within EM} framework.…

Machine Learning · Computer Science 2021-01-01 Gersende Fort , P. Gach , E. Moulines

Statistical iterative reconstruction is expected to improve the image quality of megavoltage computed tomography (MVCT). However, one of the challenges of iterative reconstruction is its large computational cost. The purpose of this work is…

In this paper, we propose a scalable algorithm for spectral embedding. The latter is a standard tool for graph clustering. However, its computational bottleneck is the eigendecomposition of the graph Laplacian matrix, which prevents its…

Machine Learning · Computer Science 2019-04-12 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

Positron Emission Tomography (PET) is an essential technique in many clinical applications that allows for quantitative imaging at the molecular level. This study aims to develop a denoising method using novel dilated convolutional neural…

Medical Physics · Physics 2021-01-27 Karl Spuhler , Mario Serrano-Sosa , Renee Cattell , Christine DeLorenzo , Chuan Huang

Score-based diffusion models have shown significant promise in the field of sparse-view CT reconstruction. However, the projection dataset is large and riddled with redundancy. Consequently, applying the diffusion model to unprocessed data…

Image and Video Processing · Electrical Eng. & Systems 2025-05-16 Pengfei Yu , Bin Huang , Minghui Zhang , Weiwen Wu , Shaoyu Wang , Qiegen Liu

This article is intended to supplement our 2015 paper in Medical Physics titled "Noise properties of CT images reconstructed by use of constrained total-variation, data-discrepancy minimization", in which ordered subsets methods were…

Medical Physics · Physics 2016-03-30 Sean Rose , Martin S. Andersen , Emil Y. Sidky , Xiaochuan Pan

This paper presents an Accelerated Preconditioned Proximal Gradient Algorithm (APPGA) for effectively solving a class of Positron Emission Tomography (PET) image reconstruction models with differentiable regularizers. We establish the…

Optimization and Control · Mathematics 2024-09-23 Yizun Lin , Yongxin He , C. Ross Schmidtlein , Deren Han

Our aim was to enhance visual quality and quantitative accuracy of dynamic positron emission tomography (PET)uptake images by improved image reconstruction, using sophisticated sparse penalty models that incorporate both 2D spatial+1D…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Ida Häggström , Yizun Lin , Si Li , Andrzej Krol , Yuesheng Xu , C. Ross Schmidtlein

Despite the astonishing performance of deep-learning based approaches for visual tasks such as semantic segmentation, they are known to produce miscalibrated predictions, which could be harmful for critical decision-making processes.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-25 Agostina J. Larrazabal , César Martínez , Jose Dolz , Enzo Ferrante

Structural equation modeling (SEM) is a popular tool in the social and behavioural sciences, where it is being applied to ever more complex data types. The high-dimensional data produced by modern sensors, brain images, or (epi)genetic…

Methodology · Statistics 2019-10-11 Erik-Jan van Kesteren , Daniel L. Oberski

Unrolled computation graphs arise in many scenarios, including training RNNs, tuning hyperparameters through unrolled optimization, and training learned optimizers. Current approaches to optimizing parameters in such computation graphs…

Machine Learning · Computer Science 2021-12-28 Paul Vicol , Luke Metz , Jascha Sohl-Dickstein

This work presents a reduced order modelling technique built on a high fidelity embedded mesh finite element method. Such methods, and in particular the CutFEM method, are attractive in the generation of projection-based reduced order…

Numerical Analysis · Mathematics 2023-08-08 Efthymios N. Karatzas , Francesco Ballarin , Gianluigi Rozza

Positron emission tomography (PET) is a widely used, highly sensitive molecular imaging in clinical diagnosis. There is interest in reducing the radiation exposure from PET but also maintaining adequate image quality. Recent methods using…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Yuxin Xue , Lei Bi , Yige Peng , Michael Fulham , David Dagan Feng , Jinman Kim

Anatomically guided PET reconstruction using MRI information has been shown to have the potential to improve PET image quality. However, these improvements are limited to PET scans with paired MRI information. In this work we employed a…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Weijie Gan , Huidong Xie , Carl von Gall , Günther Platsch , Michael T. Jurkiewicz , Andrea Andrade , Udunna C. Anazodo , Ulugbek S. Kamilov , Hongyu An , Jorge Cabello

The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. However, several important questions…

Optimization and Control · Mathematics 2022-02-23 Eduard Gorbunov , Hugo Berard , Gauthier Gidel , Nicolas Loizou

Many popular adaptive gradient methods such as Adam and RMSProp rely on an exponential moving average (EMA) to normalize their stepsizes. While the EMA makes these methods highly responsive to new gradient information, recent research has…

Machine Learning · Computer Science 2021-10-13 Brett Daley , Christopher Amato

We discuss R package SQUAREM for accelerating iterative algorithms which exhibit slow, monotone convergence. These include the well-known expectation-maximization algorithm, majorize-minimize (MM), and other EM-like algorithms such as…

Computation · Statistics 2020-03-13 Yu Du , Ravi Varadhan

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

Maximum marginal likelihood estimation (MMLE) can be formulated as the optimization of a free energy functional. From this viewpoint, the Expectation-Maximisation (EM) algorithm admits a natural interpretation as a coordinate descent method…

Machine Learning · Statistics 2026-03-10 Adam Rozzio , Rafael Athanasiades , O. Deniz Akyildiz