English
Related papers

Related papers: The Linearized Bregman Method via Split Feasibilit…

200 papers

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

The linearization of complex ordinary differential equations is studied by extending Lie's criteria for linearizability to complex functions of complex variables. It is shown that the linearization of complex ordinary differential equations…

Classical Analysis and ODEs · Mathematics 2011-07-25 S. Ali , F. M. Mahomed , Asghar Qadir

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

We propose a version of least-mean-square (LMS) algorithm for sparse system identification. Our algorithm called online linearized Bregman iteration (OLBI) is derived from minimizing the cumulative prediction error squared along with an…

Information Theory · Computer Science 2012-10-03 Tao Hu , Dmitri B. Chklovskii

A typical assumption for the analysis of first order optimization methods is the Lipschitz continuity of the gradient of the objective function. However, for many practical applications this assumption is violated, including loss functions…

Optimization and Control · Mathematics 2019-10-10 Mahesh Chandra Mukkamala , Felix Westerkamp , Emanuel Laude , Daniel Cremers , Peter Ochs

In the present work, we present numerical results for an iterative method for solving an optimal control problem with inequality contraints. The method is based on generalized Bregman distances. Under a combination of a source condition and…

Optimization and Control · Mathematics 2016-06-07 Frank Pörner

The ellipsoid method is an algorithm that solves the (weak) feasibility and linear optimization problems for convex sets by making oracle calls to their (weak) separation problem. We observe that the previously known method for showing that…

Logic in Computer Science · Computer Science 2023-10-24 Albert Atserias , Joanna Fijalkow

A numerical framework based on network partition and operator splitting is developed to solve nonlinear differential equations of large-scale dynamic processes encountered in physics, chemistry and biology. Under the assumption that those…

Computational Physics · Physics 2018-01-22 Shucheng Pan , Jianhang Wang , Xiangyu Hu , Nikolaus A. Adams

We propose a linear time and constant space algorithm for computing Euclidean projections onto sets on which a normalized sparseness measure attains a constant value. These non-convex target sets can be characterized as intersections of a…

Computational Geometry · Computer Science 2013-03-22 Markus Thom , Günther Palm

We study the conjugate gradient method for solving s system of linear equations with coefficients which are measurable functions and establish the rate of convergence of this method.

Number Theory · Mathematics 2014-09-08 King-Fai Lai

The randomized Kaczmarz methods are a popular and effective family of iterative methods for solving large-scale linear systems of equations, which have also been applied to linear feasibility problems. In this work, we propose a new block…

Optimization and Control · Mathematics 2024-06-19 Minxin Zhang , Jamie Haddock , Deanna Needell

This paper introduces adaptive Bregman proximal gradient algorithms for solving convex composite minimization problems without relying on global relative smoothness or strong convexity assumptions. Building upon recent advances in adaptive…

Optimization and Control · Mathematics 2025-08-05 Hongjia Ou , Puya Latafat , Andreas Themelis

We consider linear sparse recovery problems where additional structure regarding the support of the solution is known. The form of the structure considered is non-overlapping sets of indices that each contain part of the support. An…

Numerical Analysis · Mathematics 2021-10-05 Joseph S. Donato , Howard W. Levinson

The randomized sparse Kaczmarz method was recently proposed to recover sparse solutions of linear systems. In this work, we introduce a greedy variant of the randomized sparse Kaczmarz method by employing the sampling Kaczmarz-Motzkin…

Numerical Analysis · Mathematics 2022-04-13 Ziyang Yuan , Hui Zhang , Hongxia Wang

This paper treats the problem of minimizing a general continuously differentiable function subject to sparsity constraints. We present and analyze several different optimality criteria which are based on the notions of stationarity and…

Information Theory · Computer Science 2012-03-22 Amir Beck , Yonina C. Eldar

We consider the solution of elliptic problems on the tensor product of two physical domains as e.g. present in the approximation of the solution covariance of elliptic partial differential equations with random input. Previous sparse…

Numerical Analysis · Mathematics 2018-02-01 Helmut Harbrecht , Peter Zaspel

A risk-aware decision-making problem can be formulated as a chance-constrained linear program in probability measure space. Chance-constrained linear program in probability measure space is intractable, and no numerical method exists to…

Optimization and Control · Mathematics 2023-11-21 Xun Shen , Satoshi Ito

In this paper, the concept of matrix splitting is introduced to solve a large sparse ill-posed linear system via Tikhonov's regularization. In the regularization process, we convert the ill-posed system to a well-posed system. The…

Numerical Analysis · Mathematics 2020-04-15 Ashish Kumar Nandi , Jajati Keshari Sahoo

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

Multiplicative noise models occur in the study of several coherent imaging systems, such as synthetic aperture radar and sonar, and ultrasound and laser imaging. This type of noise is also commonly referred to as speckle. Multiplicative…

Optimization and Control · Mathematics 2009-03-25 Jose M. Bioucas-Dias , Mario A. T. Figueiredo