English
Related papers

Related papers: Completely Positive Factorization by a Riemannian …

200 papers

We aim to solve a structured convex optimization problem, where a nonsmooth function is composed with a linear operator. When opting for full splitting schemes, usually, primal-dual type methods are employed as they are effective and also…

Optimization and Control · Mathematics 2019-05-17 Radu Ioan Bot , Axel Böhm

We consider minimization of stochastic functionals that are compositions of a (potentially) non-smooth convex function $h$ and smooth function $c$ and, more generally, stochastic weakly-convex functionals. We develop a family of stochastic…

Optimization and Control · Mathematics 2018-09-25 John Duchi , Feng Ruan

We propose the convex factorization machine (CFM), which is a convex variant of the widely used Factorization Machines (FMs). Specifically, we employ a linear+quadratic model and regularize the linear term with the $\ell_2$-regularizer and…

Non-negative matrix factorization (NMF) is a matrix decomposition problem with applications in unsupervised learning. The general form of this problem (along with many of its variants) is NP-hard in nature. In our work, we explore how this…

Motivated by learning problems including max-norm regularized matrix completion and clustering, robust PCA and sparse inverse covariance selection, we propose a novel optimization algorithm for minimizing a convex objective which decomposes…

Optimization and Control · Mathematics 2012-11-20 Francesco Orabona , Andreas Argyriou , Nathan Srebro

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

Systems and Control · Computer Science 2016-11-22 Simone Naldi

We consider optimization problems with polynomial inequality constraints in non-commuting variables. These non-commuting variables are viewed as bounded operators on a Hilbert space whose dimension is not fixed and the associated polynomial…

Optimization and Control · Mathematics 2010-05-18 Stefano Pironio , Miguel Navascues , Antonio Acin

A symmetric positive semi-definite matrix A is called completely positive if there exists a matrix B with nonnegative entries such that A=BB^T. If B is such a matrix with a minimal number p of columns, then p is called the cp-rank of A. In…

Rings and Algebras · Mathematics 2016-04-22 Jan Brandts , Michal Krizek

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

Constrained quasiconvex optimization problems appear in many fields, such as economics, engineering, and management science. In particular, fractional programming, which models ratio indicators such as the profit/cost ratio as fractional…

Optimization and Control · Mathematics 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka

Variable projection solves structured optimization problems by completely minimizing over a subset of the variables while iterating over the remaining variables. Over the last 30 years, the technique has been widely used, with empirical and…

Optimization and Control · Mathematics 2020-11-23 Tristan van Leeuwen , Aleksandr Aravkin

In this paper we present an inexact zeroth-order method suitable for the solution nonsmooth and nonconvex stochastic composite optimization problems, in which the objective is split into a real-valued Lipschitz continuous stochastic…

Optimization and Control · Mathematics 2025-12-11 Spyridon Pougkakiotis , Dionysis Kalogerias

The joint approximate diagonalization of non-commuting symmetric matrices is an important process in independent component analysis. This problem can be formulated as an optimization problem on the Stiefel manifold that can be solved using…

Optimization and Control · Mathematics 2022-02-28 Hiroyuki Sato

The non-negative matrix factorization (NMF) model with an additional orthogonality constraint on one of the factor matrices, called the orthogonal NMF (ONMF), has been found a promising clustering model and can outperform the classical…

Machine Learning · Computer Science 2021-07-29 Shuai Wang , Tsung-Hui Chang , Ying Cui , Jong-Shi Pang

Randomized smoothing is currently the state-of-the-art method that provides certified robustness for deep neural networks. However, due to its excessively conservative nature, this method of incomplete verification often cannot achieve an…

Machine Learning · Computer Science 2023-12-29 Bo-Han Kung , Shang-Tse Chen

Non-negative matrix factorization (NMF) is a recently developed technique for finding parts-based, linear representations of non-negative data. Although it has successfully been applied in several applications, it does not always result in…

Machine Learning · Computer Science 2007-05-23 Patrik O. Hoyer

In this paper we provide an algorithm, similar to the simplex algorithm, which determines a rational cp-factorization of a given matrix, whenever the matrix allows such a factorization. This algorithm can be used to show that every integral…

Optimization and Control · Mathematics 2021-04-27 Mathieu Dutour Sikirić , Achill Schürmann , Frank Vallentin

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

This chapter investigates the cone of copositive matrices, with a focus on the design and analysis of conic inner approximations for it. These approximations are based on various sufficient conditions for matrix copositivity, relying on…

Optimization and Control · Mathematics 2023-03-21 Luis Felipe Vargas , Monique Laurent