English
Related papers

Related papers: Sample Complexity of Total Variation Minimization

200 papers

We study the JKO scheme for the total variation, characterize the optimizers, prove some of their qualitative properties (in particular a form of maximum principle and in some cases, a minimum principle as well). Finally, we establish a…

Analysis of PDEs · Mathematics 2018-07-09 Guillaume Carlier , Clarice Poon

Invariant risk minimization (IRM) is an arising approach to generalize invariant features to different environments in machine learning. While most related works focus on new IRM settings or new application scenarios, the mathematical…

Machine Learning · Computer Science 2024-05-20 Zhao-Rong Lai , Weiwen Wang

Temporal video grounding (TVG) aims to retrieve the time interval of a language query from an untrimmed video. A significant challenge in TVG is the low "Semantic Noise Ratio (SNR)", which results in worse performance with lower SNR. Prior…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Qi Zhang , Sipeng Zheng , Qin Jin

We propose two new variational models aimed to outperform the popular total variation (TV) model for image restoration with L$_2$ and L$_1$ fidelity terms. In particular, we introduce a space-variant generalization of the TV regularizer,…

Image and Video Processing · Electrical Eng. & Systems 2019-06-28 Alessandro Lanza , Serena Morigi , Monica Pragliola , Fiorella Sgallari

A sharp phase transition emerges in convex programs when solving the linear inverse problem, which aims to recover a structured signal from its linear measurements. This paper studies this phenomenon in theory under Gaussian random…

Information Theory · Computer Science 2018-01-04 Huan Zhang , Yulong Liu , Hong Lei

Total Generalized Variation (TGV) has recently been introduced as penalty functional for modelling images with edges as well as smooth variations. It can be interpreted as a "sparse" penalization of optimal balancing from the first up to…

Numerical Analysis · Mathematics 2020-05-21 Kristian Bredies , Tuomo Valkonen

Models like LASSO and ridge regression are extensively used in practice due to their interpretability, ease of use, and strong theoretical guarantees. Cross-validation (CV) is widely used for hyperparameter tuning in these models, but do…

Machine Learning · Statistics 2022-11-03 William T. Stephenson , Zachary Frangella , Madeleine Udell , Tamara Broderick

Parameter estimation from multiple measurement vectors (MMVs) is a fundamental problem in many signal processing applications, e.g., spectral analysis and direction-of- arrival estimation. Recently, this problem has been address using prior…

Information Theory · Computer Science 2016-06-24 Christian Steffens , Marius Pesavento , Marc E. Pfetsch

This paper presents an efficient algorithm to solve total variation (TV) regularizations of images contaminated by a both blur and noise. The unconstrained structure of the problem suggests that one can solve a constrained optimization…

Numerical Analysis · Computer Science 2018-02-13 A. Bentbib , M. El Guide , K. Jbilou

We determine statistical and computational limits for estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix, in a sparse limit, where the underlying hidden vector (that constructs the rank-one matrix)…

Information Theory · Computer Science 2020-11-02 Jean Barbier , Nicolas Macris , Cynthia Rush

Quantum hypothesis testing is an important tool for quantum information processing. Two main strategies have been widely adopted: in a minimum error discrimination strategy, the average error probability is minimized; while in an…

Quantum Physics · Physics 2020-11-25 Quntao Zhuang

We study \emph{TV regularization}, a widely used technique for eliciting structured sparsity. In particular, we propose efficient algorithms for computing prox-operators for $\ell_p$-norm TV. The most important among these is $\ell_1$-norm…

Machine Learning · Statistics 2018-01-03 Álvaro Barbero , Suvrit Sra

We produce approximation bounds on a semidefinite programming relaxation for sparse principal component analysis. These bounds control approximation ratios for tractable statistics in hypothesis testing problems where data points are…

Optimization and Control · Mathematics 2012-06-19 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

Travel-time tomography forces a trade-off between mesh resolution and stability in which the regularizer choice dominates what can be recovered. We introduce MIMIR, a differentiable framework that represents the 2D velocity field as a…

Geophysics · Physics 2026-05-12 Isao Kurosawa

Recently, total variation (TV) based minimization algorithms have achieved great success in compressive sensing (CS) recovery for natural images due to its virtue of preserving edges. However, the use of TV is not able to recover the fine…

Computer Vision and Pattern Recognition · Computer Science 2012-12-27 Jian Zhang , Shaohui Liu , Debin Zhao , Ruiqin Xiong , Siwei Ma

Adaptive measurements were recently shown to significantly improve the performance of quantum state tomography. Utilizing information about the system for the on-line choice of optimal measurements allows to reach the ultimate bounds of…

The core of many approaches for the resolution of variational inverse problems arising in signal and image processing consists of promoting the sought solution to have a sparse representation in a well-suited space. A crucial task in this…

Numerical Analysis · Mathematics 2022-09-07 Gabriele Scrivanti , Emilie Chouzenoux , Jean-Christophe Pesquet

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Change-point models are widely used by statisticians to model drastic changes in the pattern of observed data. Least squares/maximum likelihood based estimation of change-points leads to curious asymptotic phenomena. When the change-point…

Statistics Theory · Mathematics 2015-10-20 Rui Song , Moulinath Banerjee , Michael R. Kosorok

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

Information Theory · Computer Science 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari