English
Related papers

Related papers: Simplifying Optimal Transport through Schatten-$p$…

200 papers

We develop a novel theoretical framework for understating OT schemes respecting a class structure. For this purpose, we propose a convex OT program with a sum-of-norms regularization term, which provably recovers the underlying class…

Machine Learning · Computer Science 2023-05-23 Arman Rahbar , Ashkan Panahi , Morteza Haghir Chehreghani , Devdatt Dubhashi , Hamid Krim

In this paper, we bring forward a completely perturbed nonconvex Schatten $p$-minimization to address a model of completely perturbed low-rank matrix recovery. The paper that based on the restricted isometry property generalizes the…

Information Theory · Computer Science 2020-06-12 Jianwen Huang , Wendong Wang , Feng Zhang , Jianjun Wang

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

This paper develops a new class of nonconvex regularizers for low-rank matrix recovery. Many regularizers are motivated as convex relaxations of the matrix rank function. Our new factor group-sparse regularizers are motivated as a…

Machine Learning · Computer Science 2019-11-19 Jicong Fan , Lijun Ding , Yudong Chen , Madeleine Udell

In this paper, we consider the matrix recovery from rank-one projection measurements proposed in [Cai and Zhang, Ann. Statist., 43(2015), 102-138], via nonconvex minimization. We establish a sufficient identifiability condition, which can…

Information Theory · Computer Science 2018-06-29 Peng Li , Wengu Chen

Higher-order tensors are well-suited for representing multi-dimensional data, such as images and videos, which typically characterize low-rank structures. Low-rank tensor decomposition has become essential in machine learning and computer…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Zhengyun Cheng , Ruizhe Zhang , Guanwen Zhang , Yi Xu , Xiangyang Ji , Wei Zhou

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

Machine Learning · Statistics 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

We address some theoretical guarantees for Schatten-$p$ quasi-norm minimization ($p \in (0,1]$) in recovering low-rank matrices from compressed linear measurements. Firstly, using null space properties of the measurement operator, we…

Information Theory · Computer Science 2014-10-28 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

The Schatten-$p$ norm ($0<p<1$) has been widely used to replace the nuclear norm for better approximating the rank function. However, existing methods are either 1) not scalable for large scale problems due to relying on singular value…

Machine Learning · Statistics 2016-11-28 Chen Xu , Zhouchen Lin , Hongbin Zha

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the…

Machine Learning · Statistics 2018-02-21 Mathieu Blondel , Vivien Seguy , Antoine Rolet

We introduce a new class of convex-regularized Optimal Transport losses, which generalizes the classical Entropy-regularization of Optimal Transport and Sinkhorn divergences, and propose a generalized Sinkhorn algorithm. Our framework…

Optimization and Control · Mathematics 2020-07-03 Simone Di Marino , Augusto Gerolin

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The type of…

Machine Learning · Statistics 2019-06-11 Saied Mahdian , Jose Blanchet , Peter Glynn

Recent theory of mapping an image into a structured low-rank Toeplitz or Hankel matrix has become an effective method to restore images. In this paper, we introduce a generalized structured low-rank algorithm to recover images from their…

Image and Video Processing · Electrical Eng. & Systems 2018-11-28 Yue Hu , Xiaohan Liu , Mathews Jacob

We propose a generic framework based on a new stochastic variance-reduced gradient descent algorithm for accelerating nonconvex low-rank matrix recovery. Starting from an appropriate initial estimator, our proposed algorithm performs…

Machine Learning · Statistics 2017-01-20 Lingxiao Wang , Xiao Zhang , Quanquan Gu

Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex…

Machine Learning · Computer Science 2023-06-21 Marin Ballu , Quentin Berthet

We discuss structured Schatten norms for tensor decomposition that includes two recently proposed norms ("overlapped" and "latent") for convex-optimization-based tensor decomposition, and connect tensor decomposition with wider literature…

Machine Learning · Statistics 2013-03-27 Ryota Tomioka , Taiji Suzuki

The Schatten-$p$ quasi-norm with $p\in(0,1)$ has recently gained considerable attention in various low-rank matrix estimation problems offering significant benefits over relevant convex heuristics such as the nuclear norm. However, due to…

Numerical Analysis · Mathematics 2020-10-28 Paris Giampouras , René Vidal , Athanasios Rontogiannis , Benjamin Haeffele

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

Low rank matrix approximation (LRMA), which aims to recover the underlying low rank matrix from its degraded observation, has a wide range of applications in computer vision. The latest LRMA methods resort to using the nuclear norm…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Yuan Xie , Shuhang Gu , Yan Liu , Wangmeng Zuo , Wensheng Zhang , Lei Zhang

Optimal transport (OT) naturally arises in a wide range of machine learning applications but may often become the computational bottleneck. Recently, one line of works propose to solve OT approximately by searching the \emph{transport plan}…

Machine Learning · Computer Science 2021-11-15 Weijie Liu , Chao Zhang , Nenggan Zheng , Hui Qian
‹ Prev 1 2 3 10 Next ›