English
Related papers

Related papers: Inverse Scale Space Iterations for Non-Convex Vari…

200 papers

In this paper, we consider the problem of phase retrieval, which consists of recovering an $n$-dimensional real vector from the magnitude of its $m$ linear measurements. We propose a mirror descent (or Bregman gradient descent) algorithm…

Optimization and Control · Mathematics 2024-06-21 Jean-Jacques Godeme , Jalal Fadili , Xavier Buet , Myriam Zerrad , Michel Lequime , Claude Amra

Numerous tasks in imaging and vision can be formulated as variational problems over vector-valued maps. We approach the relaxation and convexification of such vectorial variational problems via a lifting to the space of currents. To that…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Thomas Möllenhoff , Daniel Cremers

We derive and analyse a new variant of the iteratively regularized Landweber iteration, for solving linear and nonlinear ill-posed inverse problems. The method takes into account training data, which are used to estimate the interior of a…

Numerical Analysis · Mathematics 2020-03-19 Andrea Aspri , Sebastian Banert , Ozan Öktem , Otmar Scherzer

Bregman divergences play a central role in the design and analysis of a range of machine learning algorithms. This paper explores the use of Bregman divergences to establish reductions between such algorithms and their analyses. We present…

Machine Learning · Computer Science 2016-07-04 Richard Nock , Aditya Krishna Menon , Cheng Soon Ong

Circle- and sphere-valued data play a significant role in inverse problems like magnetic resonance phase imaging and radar interferometry, in the analysis of directional information, and in color restoration tasks. In this paper, we aim to…

Numerical Analysis · Mathematics 2024-04-23 Robert Beinert , Jonas Bresch

We consider the problem of minimizing the sum of non-smooth convex functions in non-Euclidean spaces, e.g., probability simplex, via only local computation and communication on an undirected graph. We propose two algorithms motivated by…

Optimization and Control · Mathematics 2019-08-22 Yue Yu , Behçet Açıkmeşe , Mehran Mesbahi

This paper addresses the structurally-constrained sparse decomposition of multi-dimensional signals onto overcomplete families of vectors, called dictionaries. The contribution of the paper is threefold. Firstly, a generic spatio-temporal…

Data Structures and Algorithms · Computer Science 2016-10-03 Yoann Isaac , Quentin Barthélemy , Cédric Gouy-Pailler , Michèle Sebag , Jamal Atif

This work presents a fast and non-convex algorithm for robust subspace recovery. The data sets considered include inliers drawn around a low-dimensional subspace of a higher dimensional ambient space, and a possibly large portion of…

Machine Learning · Computer Science 2018-11-07 Gilad Lerman , Tyler Maunu

Inverse problems are in many cases solved with optimization techniques. When the underlying model is linear, first-order gradient methods are usually sufficient. With nonlinear models, due to nonconvexity, one must often resort to…

Numerical Analysis · Mathematics 2023-05-15 Arttu Arjas , Mikko J. Sillanpää , Andreas Hauptmann

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

This paper addresses the challenging and interesting inverse problem of reconstructing the spatially varying dielectric constant of a medium from phaseless backscattering measurements generated by single-point illumination. The underlying…

Numerical Analysis · Mathematics 2025-06-30 Thuy T. Le , Phuong M. Nguyen , Loc H. Nguyen

We start out by demonstrating that an elementary learning task, corresponding to the training of a single linear neuron in a convolutional neural network, can be solved for feature spaces of very high dimensionality. In a second step,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Marco Loog , François Lauze

This paper presents a novel strategy for high-fidelity image restoration by characterizing both local smoothness and nonlocal self-similarity of natural images in a unified statistical manner. The main contributions are three-folds. First,…

Multimedia · Computer Science 2014-05-14 Jian Zhang , Debin Zhao , Ruiqin Xiong , Siwei Ma , Wen Gao

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

The paper introduces scaled Bregman distances of probability distributions which admit non-uniform contributions of observed events. They are introduced in a general form covering not only the distances of discrete and continuous stochastic…

Information Theory · Computer Science 2021-05-12 Wolfgang Stummer , Igor Vajda

Simulating multi-scale phenomena such as turbulent fluid flows is typically computationally very expensive. Filtering the smaller scales allows for using coarse discretizations, however, this requires closure models to account for the…

Computational Engineering, Finance, and Science · Computer Science 2022-08-22 Syver Døving Agdestein , Benjamin Sanderse

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

Sparse solution problems play an important role in both signal processing and image restoration. In this paper, we propose a stochastic column-block nonlinear Bregman method for efficiently computing sparse solutions to nonlinear systems.…

Numerical Analysis · Mathematics 2026-05-11 Wendi Bao , Naiyu Jiang , Lili Xing , Weiguo Li

Ill-posed linear inverse problems (ILIP), such as restoration and reconstruction, are a core topic of signal/image processing. A standard approach to deal with ILIP uses a constrained optimization problem, where a regularization function is…

Optimization and Control · Mathematics 2016-11-15 Manya V. Afonso , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo