English
Related papers

Related papers: Regularized Gradient Descent: A Nonconvex Recipe f…

200 papers

This paper proposes a stochastic gradient descent method with an adaptive Gaussian noise term for the global minimization of nearly convex functions, which are nonconvex and possess multiple strict local minimizers. The noise term,…

Optimization and Control · Mathematics 2025-08-05 Chenglong Bao , Liang Chen , Weizhi Shao

We propose a class of estimators for deconvolution in mixture models based on a simple two-step "bin-and-smooth" procedure applied to histogram counts. The method is both statistically and computationally efficient: by exploiting recent…

Methodology · Statistics 2018-08-01 Oscar Hernan Madrid Padilla , Nicholas G. Polson , James G. Scott

Computational sensing strategies often suffer from calibration errors in the physical implementation of their ideal sensing models. Such uncertainties are typically addressed by using multiple, accurately chosen training signals to recover…

Information Theory · Computer Science 2022-05-26 Valerio Cambareri , Laurent Jacques

This paper addresses recovery of a kernel $\boldsymbol{h}\in \mathbb{C}^{n}$ and a signal $\boldsymbol{x}\in \mathbb{C}^{n}$ from the low-resolution phaseless measurements of their noisy circular convolution $\boldsymbol{y} = \left \rvert…

Information Theory · Computer Science 2021-12-07 Samuel Pinilla , Kumar Vijay Mishra , Brian M. Sadler

Many optimization problems arising in high-dimensional statistics decompose naturally into a sum of several terms, where the individual terms are relatively simple but the composite objective function can only be optimized with iterative…

Optimization and Control · Mathematics 2016-06-30 Rina Foygel Barber , Emil Y. Sidky

We investigate efficient algorithmic realisations for robust deconvolution of grey-value images with known space-invariant point-spread function, with emphasis on 1D motion blur scenarios. The goal is to make deconvolution suitable as…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Martin Welk , Patrik Raudaschl , Thomas Schwarzbauer , Martin Erler , Martin Läuter

We propose an optimization method for minimizing the finite sums of smooth convex functions. Our method incorporates an accelerated gradient descent (AGD) and a stochastic variance reduction gradient (SVRG) in a mini-batch setting. Unlike…

Machine Learning · Statistics 2015-06-11 Atsushi Nitanda

In this paper, we study the generalized phase retrieval problem: to recover a signal $\bm{x}\in\mathbb{C}^n$ from the measurements $y_r=\lvert \langle\bm{a}_r,\bm{x}\rangle\rvert^2$, $r=1,2,\ldots,m$. The problem can be reformulated as a…

Optimization and Control · Mathematics 2016-07-06 Ji Li , Tie Zhou

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and…

Optimization and Control · Mathematics 2023-03-07 Luyao Guo , Xinli Shi , Jinde Cao , Zihao Wang

We present an algorithm that efficiently performs blind decoding of MIMO signals. That is, given no channel state information (CSI) at either the transmitter or receiver, our algorithm takes a block of samples and returns an estimate of the…

Signal Processing · Electrical Eng. & Systems 2019-05-10 Thomas Dean , Jonathan Perlstein , Mary Wootters , Andrea Goldsmith

High dimensional and/or nonconvex optimization remains a challenging and important problem across a wide range of fields, such as machine learning, data assimilation, and partial differential equation (PDE) constrained optimization. Here we…

Optimization and Control · Mathematics 2025-08-29 Brian K. Tran , Ben S. Southworth , David B. Cavender , Sam Olivier , Syed A. Shah , Tommaso Buvoli

Our work considers the optimization of the sum of a non-smooth convex function and a finite family of composite convex functions, each one of which is composed of a convex function and a bounded linear operator. This type of problem is…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Chuan-Xi Zhu , Meng Wen , Ji-Gen Peng

Let $(Y_i,\theta_i)$, $i=1,...,n$, be independent random vectors distributed like $(Y,\theta) \sim G^*$, where the marginal distribution of $\theta$ is completely unknown, and the conditional distribution of $Y$ conditional on $\theta$ is…

Statistics Theory · Mathematics 2014-06-24 Eitan Greenshtein , Theodor Itskov

We consider the problem of recovering two unknown vectors, $\boldsymbol{w}$ and $\boldsymbol{x}$, of length $L$ from their circular convolution. We make the structural assumption that the two vectors are members of known subspaces, one with…

Information Theory · Computer Science 2018-06-26 Ali Ahmed , Benjamin Recht , Justin Romberg

We consider a variable metric and inexact version of the FISTA-type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed…

Optimization and Control · Mathematics 2021-01-12 Simone Rebegoldi , Luca Calatroni

In this paper, we consider the highly ill-posed problem of jointly recovering two real-valued signals from the phaseless measurements of their circular convolution. The problem arises in various imaging modalities such as Fourier…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Fahad Shamshad , Ali Ahmed

In this paper, we consider the nonsmooth convex optimization problems over the fixed point constraint sets of firmly nonexpansive operators. To find an optimal solution of the problem, we present an iterative method based on the hybrid…

Optimization and Control · Mathematics 2026-03-23 Ontima Pankoon , Nimit Nimana , Yeol Je Cho

Continuous optimization is an important problem in many areas of AI, including vision, robotics, probabilistic inference, and machine learning. Unfortunately, most real-world optimization problems are nonconvex, causing standard convex…

Artificial Intelligence · Computer Science 2016-11-10 Abram L. Friesen , Pedro Domingos

Conventional model-based image denoising optimizations employ convex regularization terms, such as total variation (TV) that convexifies the $\ell_0$-norm to promote sparse signal representation. Instead, we propose a new non-convex total…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Songlin Wei , Gene Cheung , Fei Chen , Ivan Selesnick
‹ Prev 1 4 5 6 7 8 10 Next ›