English
Related papers

Related papers: Minimax optimal convex methods for Poisson inverse…

200 papers

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

One way to understand time-series data is to identify the underlying dynamical system which generates it. This task can be done by selecting an appropriate model and a set of parameters which best fits the dynamics while providing the…

Optimization and Control · Mathematics 2018-05-17 Linan Zhang , Hayden Schaeffer

Convex-concave min-max problems are ubiquitous in machine learning, and people usually utilize first-order methods (e.g., gradient descent ascent) to find the optimal solution. One feature which separates convex-concave min-max problems…

Optimization and Control · Mathematics 2022-03-09 Mingrui Liu , Francesco Orabona

This paper focuses on efficient computational approaches to compute approximate solutions of a linear inverse problem that is contaminated with mixed Poisson--Gaussian noise, and when there are additional outliers in the measured data. The…

Numerical Analysis · Mathematics 2018-01-22 Marie Kubínová , James G. Nagy

A min-max formula is proved for the minimum of an integer-valued separable discrete convex function where the minimum is taken over the set of integral elements of a box total dual integral (box-TDI) polyhedron. One variant of the theorem…

Combinatorics · Mathematics 2021-01-28 András Frank , Kazuo Murota

We address the minimization of a smooth objective function under an $\ell_0$-constraint and simple convex constraints. When the problem has no constraints except the $\ell_0$-constraint, some efficient algorithms are available; for example,…

Optimization and Control · Mathematics 2017-01-31 Katsuya Tono , Akiko Takeda , Jun-ya Gotoh

We study randomized sketching methods for approximately solving least-squares problem with a general convex constraint. The quality of a least-squares approximation can be assessed in different ways: either in terms of the value of the…

Optimization and Control · Mathematics 2014-11-04 Mert Pilanci , Martin J. Wainwright

We propose a general framework for solving quantum state estimation problems using the minimum relative entropy criterion. A convex optimization approach allows us to decide the feasibility of the problem given the data and, whenever…

Quantum Physics · Physics 2013-01-29 Mattia Zorzi , Francesco Ticozzi , Augusto Ferrante

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

We focus on the minimization of the least square loss function either under a $k$-sparse constraint or with a sparse penalty term. Based on recent results, we reformulate the $\ell_0$ pseudo-norm exactly as a convex minimization problem by…

Optimization and Control · Mathematics 2019-03-07 Arne Bechensteen , Laure Blanc-Féraud , Gilles Aubert

Let $\Omega\subset\mathbb{R}^n$, $n\geq 2$, be a bounded, open and convex set and let $f$ be a positive and non-increasing function depending only on the distance from the boundary of $\Omega$. We consider the $p-$torsional rigidity…

Analysis of PDEs · Mathematics 2022-10-06 Vincenzo Amato , Alba Lia Masiello , Gloria Paoli , Rossano Sannipoli

Experimental designs that are minimax in the presence of model misspecifications have been constructed so as to minimize the maximum, over classes of alternate response models, of the integrated mean squared error of the predicted values.…

Statistics Theory · Mathematics 2026-04-27 Rui Hu , Douglas P. Wiens

We study inexact fixed-point proximity algorithms for solving a class of sparse regularization problems involving the $\ell_0$ norm. Specifically, the $\ell_0$ model has an objective function that is the sum of a convex fidelity term and a…

Optimization and Control · Mathematics 2024-04-30 Ronglong Fang , Yuesheng Xu , Mingsong Yan

We study online convex optimization under stochastic sub-gradient observation faults, where we introduce adaptive algorithms with minimax optimal regret guarantees. We specifically study scenarios where our sub-gradient observations can be…

Machine Learning · Computer Science 2019-04-23 Hakan Gokcesu , Suleyman S. Kozat

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

Optimization and Control · Mathematics 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

We consider a statistical inverse learning problem, where we observe the image of a function $f$ through a linear operator $A$ at i.i.d. random design points $X_i$, superposed with an additive noise. The distribution of the design points is…

Machine Learning · Statistics 2016-04-15 Gilles Blanchard , Nicole Mücke

Recent studies of under-determined linear systems of equations with sparse solutions showed a great practical and theoretical efficiency of a particular technique called $\ell_1$-optimization. Seminal works \cite{CRT,DOnoho06CS} rigorously…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Yann Traonmilin , Rémi Gribonval , Samuel Vaiter

Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an…

Numerical Analysis · Mathematics 2013-01-01 I. Daubechies , M. Fornasier , I. Loris

In this paper we study the auxiliary problems that appear in $p$-order tensor methods for unconstrained minimization of convex functions with $\nu$-H\"{o}lder continuous $p$th derivatives. This type of auxiliary problems corresponds to the…

Optimization and Control · Mathematics 2021-06-07 Geovani Nunes Grapiglia , Yurii Nesterov
‹ Prev 1 8 9 10 Next ›