English
Related papers

Related papers: Stochastic EM methods with Variance Reduction for …

200 papers

In this paper, we provide a novel method for the estimation of unknown parameters of the Gaussian Mixture Model (GMM) in Positron Emission Tomography (PET). A vast majority of PET imaging methods are based on reconstruction model that is…

Signal Processing · Electrical Eng. & Systems 2023-06-30 Tomislav Matulić , Damir Seršić

We consider a regularized expected reward optimization problem in the non-oblivious setting that covers many existing problems in reinforcement learning (RL). In order to solve such an optimization problem, we apply and analyze the…

Machine Learning · Computer Science 2024-08-21 Ling Liang , Haizhao Yang

The Exponential Moving Average (EMA) is a cornerstone of widely used optimizers such as Adam. However, existing theoretical analyses of Adam-style methods have notable limitations: their guarantees can remain suboptimal in the zero-noise…

Machine Learning · Computer Science 2026-04-17 Ganzhao Yuan

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are batch methods designed mainly based on the convex optimization, say, the…

Machine Learning · Statistics 2018-02-01 Ke Ma , Jinshan Zeng , Jiechao Xiong , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

Statistics Theory · Mathematics 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

Deep learning-based reconstruction of positron emission tomography(PET) data has gained increasing attention in recent years. While these methods achieve fast reconstruction,concerns remain regarding quantitative accuracy and the presence…

Stochastic nested optimization, including stochastic compositional, min-max and bilevel optimization, is gaining popularity in many machine learning applications. While the three problems share the nested structure, existing works often…

Machine Learning · Statistics 2021-06-28 Tianyi Chen , Yuejiao Sun , Wotao Yin

Patient movement in emission tomography deteriorates reconstruction quality because of motion blur. Gating the data improves the situation somewhat: each gate contains a movement phase which is approximately stationary. A standard method is…

Image and Video Processing · Electrical Eng. & Systems 2020-02-24 Ozan Öktem , Camille Pouchol , Olivier Verdier

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

We introduce Equivariant Neural Field Expectation Maximization (EFEM), a simple, effective, and robust geometric algorithm that can segment objects in 3D scenes without annotations or training on scenes. We achieve such unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jiahui Lei , Congyue Deng , Karl Schmeckpeper , Leonidas Guibas , Kostas Daniilidis

Central to the application of many multi-view geometry algorithms is the extraction of matching points between multiple viewpoints, enabling classical tasks such as camera pose estimation and 3D reconstruction. Many approaches that…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Alexander Mai , Allen Yang , Dominique E. Meyer

The study of convex optimization has historically been concerned with worst-case convergence rates. The development of the Optimized Gradient Method (OGM), due to \citet{drori2012PerformanceOF,Kim2016optimal}, marked a major milestone in…

Optimization and Control · Mathematics 2026-04-21 Benjamin Grimmer , Kevin Shu , Alex L. Wang

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

In this paper, we study a stochastic strongly convex optimization problem and propose three classes of variable sample-size stochastic first-order methods including the standard stochastic gradient descent method, its accelerated variant,…

Optimization and Control · Mathematics 2024-05-08 Jinlong Lei , Uday V. Shanbhag

Dynamic positron emission tomography (dPET) image reconstruction is extremely challenging due to the limited counts received in individual frame. In this paper, we propose a spatial-temporal convolutional primal dual network (STPDnet) for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-09 Rui Hu , Jianan Cui , Chengjin Yu , Yunmei Chen , Huafeng Liu

A novel method for sinogram denoise based on Generative Adversarial Networks (GANs) in the field of SPECT imaging is presented. Projection data from software phantoms were used to train the proposed model. For evaluation of the efficacy of…

Artificial Intelligence · Computer Science 2021-08-10 Charalambos Chrysostomou

We study the convergence of accelerated stochastic gradient descent for strongly convex objectives under the growth condition, which states that the variance of stochastic gradient is bounded by a multiplicative part that grows with the…

Optimization and Control · Mathematics 2023-11-01 You-Lin Chen , Sen Na , Mladen Kolar

The Optimized Gradient Method (OGM), its strongly convex extension, the Information Theoretical Exact Method (ITEM), as well as the related Triple Momentum Method (TMM) have superior convergence guarantees when compared to the Fast Gradient…

Optimization and Control · Mathematics 2024-05-14 Mihai I. Florea

This paper generalizes the optimized gradient method (OGM) that achieves the optimal worst-case cost function bound of first-order methods for smooth convex minimization. Specifically, this paper studies a generalized formulation of OGM and…

Optimization and Control · Mathematics 2019-06-14 Donghwan Kim , Jeffrey A. Fessler