English
Related papers

Related papers: A subspace-accelerated split Bregman method for sp…

200 papers

In this paper we address the problem of recovering a matrix, with inherent low rank structure, from its lower dimensional projections. This problem is frequently encountered in wide range of areas including pattern recognition, wireless…

Numerical Analysis · Computer Science 2013-12-25 Anupriya Gogna , Ankita Shukla , Angshul Majumdar

The linearized Bregman method is a method to calculate sparse solutions to systems of linear equations. We formulate this problem as a split feasibility problem, propose an algorithmic framework based on Bregman projections and prove a…

Optimization and Control · Mathematics 2013-09-11 Dirk A. Lorenz , Frank Schöpfer , Stephan Wenger

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova

In this paper, we propose and analyze an accelerated linearized Bregman (ALB) method for solving the basis pursuit and related sparse optimization problems. This accelerated algorithm is based on the fact that the linearized Bregman (LB)…

Optimization and Control · Mathematics 2011-06-28 Bo Huang , Shiqian Ma , Donald Goldfarb

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

rdering of regression or classification coefficients occurs in many real-world applications. Fused Lasso exploits this ordering by explicitly regularizing the differences between neighboring coefficients through an $\ell_1$ norm…

Computation · Statistics 2010-06-29 Gui-Bo Ye , Xiaohui Xie

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

Classical model reduction techniques project the governing equations onto a linear subspace of the original state space. More recent data-driven techniques use neural networks to enable nonlinear projections. Whilst those often enable…

Numerical Analysis · Mathematics 2024-06-19 Tjeerd Jan Heeringa , Christoph Brune , Mengwu Guo

Minimizing sum of two functions under a linear constraint is what we called splitting problem. This convex optimization has wide applications in machine learning problems, such as Lasso, Group Lasso and Sparse logistic regression. A recent…

Computation · Statistics 2017-11-20 Sen Na , Cho-Jui Hsieh

In this paper, we introduce a new nonlinear evolution partial differential equation for sparse deconvolution problems. The proposed PDE has the form of continuity equation that arises in various research areas, e.g. fluid dynamics and…

Optimization and Control · Mathematics 2011-04-04 Yu Mao , Bin Dong , Stanley Osher

This paper presents a novel method for recovering sparse vectors from linear models corrupted by Poisson noise. The contribution is twofold. First, an operator defined via the external division of two Bregman proximity operators is…

Machine Learning · Computer Science 2026-02-13 Kazuki Haishima , Kyohei Suzuki , Konstantinos Slavakis

In this paper, we develop a novel framework to optimally design spectral estimators for phase retrieval given measurements realized from an arbitrary model. We begin by deconstructing spectral methods, and identify the fundamental…

Signal Processing · Electrical Eng. & Systems 2020-12-14 Bariscan Yonel , Birsen Yazici

We study the problem of minimizing a relatively-smooth convex function using stochastic Bregman gradient methods. We first prove the convergence of Bregman Stochastic Gradient Descent (BSGD) to a region that depends on the noise (magnitude…

Optimization and Control · Mathematics 2021-04-21 Radu-Alexandru Dragomir , Mathieu Even , Hadrien Hendrikx

Symmetric matrix decomposition is an active research area in machine learning. This paper focuses on exploiting the low-rank structure of non-negative and sparse symmetric matrices via the rectified linear unit (ReLU) activation function.…

Machine Learning · Computer Science 2025-04-29 Qingsong Wang

Sparse inversion and classification problems are ubiquitous in modern data science and imaging. They are often formulated as non-smooth minimisation problems. In sparse inversion, we minimise, e.g., the sum of a data fidelity term and an…

Numerical Analysis · Mathematics 2022-11-23 Jonas Latz

Optimizing strongly convex functions subject to linear constraints is a fundamental problem with numerous applications. In this work, we propose a block (accelerated) randomized Bregman-Kaczmarz method that only uses a block of constraints…

Numerical Analysis · Mathematics 2024-04-04 Lionel Tondji , Ion Necoara , Dirk A. Lorenz

Variational formulations of reconstruction in computed tomography have the notable drawback of requiring repeated evaluations of both the forward Radon transform and either its adjoint or an approximate inverse transform which are…

Numerical Analysis · Mathematics 2017-05-23 Richard C. Barnard , Rick Archibald

Recovery of a sparse signal from a nonlinear system arises in many practical applications including compressive sensing, image reconstruction and machine learning. In this paper, a fast block nonlinear Bregman-Kaczmarz method with averaging…

Numerical Analysis · Mathematics 2025-02-24 Aqin Xiao , Xiangyu Gao , Jun-Feng Yin

In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to…

Statistics Theory · Mathematics 2016-01-22 Stanley Osher , Feng Ruan , Jiechao Xiong , Yuan Yao , Wotao Yin