English
Related papers

Related papers: The Linearized Bregman Method via Split Feasibilit…

200 papers

We consider the problem of covariance matrix estimation in the presence of latent variables. Under suitable conditions, it is possible to learn the marginal covariance matrix of the observed variables via a tractable convex program, where…

Machine Learning · Statistics 2011-10-17 Gui-Bo Ye , Yuanfeng Wang , Yifei Chen , Xiaohui Xie

In this article we continue our investigation of the iterative regularization method for optimization problems based on Bregman distances. The optimization problems are subject to pointwise inequality constraints in $L^2(\Omega)$. We…

Optimization and Control · Mathematics 2016-08-25 Frank Pörner

Classical linear metric learning methods have recently been extended along two distinct lines: deep metric learning methods for learning embeddings of the data using neural networks, and Bregman divergence learning approaches for extending…

Machine Learning · Computer Science 2020-05-07 Kubra Cilingir , Rachel Manzelli , Brian Kulis

In high-dimensional settings, sparse structures are critical for efficiency in term of memory and computation complexity. For a linear system, to find the sparsest solution provided with an over-complete dictionary of features directly is…

Machine Learning · Statistics 2020-07-09 Yiping Jiang , Tianshi Chen

We propose a novel stochastic distributed method for both monotone and strongly monotone variational inequalities with Lipschitz operator and proper convex regularizers arising in various applications from game theory to adversarial…

Optimization and Control · Mathematics 2024-10-07 Aleksandr Beznosikov , Darina Dvinskikh , Dmitry Bylinkin , Andrei Semenov , Alexander Gasnikov

We consider large-scale nonlinear least squares problems with sparse residuals, each of them depending on a small number of variables. A decoupling procedure which results in a splitting of the original problems into a sequence of…

Optimization and Control · Mathematics 2023-01-12 Natasa Krejic , Greta Malaspina , Lense Swaenen

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

Line spectral estimation is the problem of recovering the frequencies and amplitudes of a mixture of a few sinusoids from equispaced samples. However, in a variety of signal processing problems arising in imaging, radar, and localization we…

Information Theory · Computer Science 2016-09-28 Reinhard Heckel , Mahdi Soltanolkotabi

In this work, we focus on separable convex optimization problems with linear and box constraints and compute the solution in closed-form as a function of some Lagrange multipliers that can be easily computed in a finite number of…

Information Theory · Computer Science 2014-03-25 Antonio A. D'Amico , Luca Sanguinetti , Daniel P. Palomar

In the past few years powerful generalizations to the Euclidean k-means problem have been made, such as Bregman clustering [7], co-clustering (i.e., simultaneous clustering of rows and columns of an input matrix) [9,18], and tensor…

Data Structures and Algorithms · Computer Science 2009-11-09 Stefanie Jegelka , Suvrit Sra , Arindam Banerjee

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

We study randomized variants of two classical algorithms: coordinate descent for systems of linear equations and iterated projections for systems of linear inequalities. Expanding on a recent randomized iterated projection algorithm of…

Optimization and Control · Mathematics 2008-06-19 D. Leventhal , A. S. Lewis

For the sparsity-rank-aware least squares estimations, the LiGME (Linearly involved Generalized Moreau Enhanced) model was established recently in [Abe, Yamagishi, Yamada, 2020] to use certain nonconvex enhancements of linearly involved…

Optimization and Control · Mathematics 2021-05-17 Wataru Yata , Masao Yamagishi , Isao Yamada

Efficiently solving sparse linear algebraic equations is an important research topic of numerical simulation. Commonly used approaches include direct methods and iterative methods. Compared with the direct methods, the iterative methods…

Numerical Analysis · Mathematics 2023-10-11 Haifeng Zou , Xiaowen Xu , Chen-Song Zhang

The goal of this paper is to provide computational tools able to find a solution of a system of polynomial inequalities. The set of inequalities is reformulated as a system of polynomial equations. Three different methods, two of which…

Dynamical Systems · Mathematics 2016-03-04 Laura Menini , Corrado Possieri , Antonio Tornambè

Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

The Kaczmarz algorithm is popular for iteratively solving an overdetermined system of linear equations. The traditional Kaczmarz algorithm can approximate the solution in few sweeps through the equations but a randomized version of the…

Numerical Analysis · Computer Science 2014-02-04 Hemant Kumar Aggarwal , Angshul Majumdar

We consider Lie and Strang splitting for the time integration of constrained partial differential equations with a nonlinear reaction term. Since such systems are known to be sensitive with respect to perturbations, the splitting procedure…

Numerical Analysis · Mathematics 2016-07-27 Robert Altmann , Alexander Ostermann

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

The goal of this paper is to further develop an approach to inverse problems with imperfect forward operators that is based on partially ordered spaces. Studying the dual problem yields useful insights into the convergence of the…

Numerical Analysis · Mathematics 2019-01-30 Martin Burger , Yury Korolev , Julian Rasch
‹ Prev 1 4 5 6 7 8 10 Next ›