English
Related papers

Related papers: Low-rank tensor approximations for solving multi-m…

200 papers

We study MinMax solution methods for a general class of optimization problems related to (and including) optimal transport. Theoretically, the focus is on fitting a large class of problems into a single MinMax framework and generalizing…

Optimization and Control · Mathematics 2020-10-23 Luca De Gennaro Aquino , Stephan Eckstein

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and H\"older continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general…

Optimization and Control · Mathematics 2022-07-06 Stephan Eckstein , Marcel Nutz

Adapted optimal transport (AOT) problems are optimal transport problems for distributions of a time series where couplings are constrained to have a temporal causal structure. In this paper, we develop computational tools for solving AOT…

Probability · Mathematics 2023-04-26 Stephan Eckstein , Gudmund Pammer

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved…

Machine Learning · Statistics 2025-12-30 O. Deniz Akyildiz , Pierre Del Moral , Joaquín Miguez

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

In this note we take a new look at the local convergence of alternating optimization methods for low-rank matrices and tensors. Our abstract interpretation as sequential optimization on moving subspaces yields insightful reformulations of…

Numerical Analysis · Mathematics 2019-01-14 Ivan Oseledets , Maxim Rakhuba , André Uschmajew

Low-rank approximation in data streams is a fundamental and significant task in computing science, machine learning and statistics. Multiple streaming algorithms have emerged over years and most of them are inspired by randomized…

Data Structures and Algorithms · Computer Science 2022-09-30 Cuiyu Liu , Chuanfu Xiao , Mingshuo Ding , Chao Yang

This article describes a set of methods for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn--Knopp…

Numerical Analysis · Mathematics 2021-04-02 Alexis Thibault , Lénaïc Chizat , Charles Dossal , Nicolas Papadakis

This paper studies the traffic state estimation (TSE) problem using sparse observations from mobile sensors. Most existing TSE methods either rely on well-defined physical traffic flow models or require large amounts of simulation data as…

Machine Learning · Computer Science 2022-06-15 Xudong Wang , Yuankai Wu , Dingyi Zhuang , Lijun Sun

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

This paper describes a new algorithm for computing a low-Tucker-rank approximation of a tensor. The method applies a randomized linear map to the tensor to obtain a sketch that captures the important directions within each mode, as well as…

Numerical Analysis · Mathematics 2021-05-04 Yiming Sun , Yang Guo , Charlene Luo , Joel Tropp , Madeleine Udell

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

This work presents a low-rank tensor model for multi-dimensional Markov chains. A common approach to simplify the dynamical behavior of a Markov chain is to impose low-rankness on the transition probability matrix. Inspired by the success…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Madeline Navarro , Sergio Rozada , Antonio G. Marques , Santiago Segarra

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 John Lee , Nicholas P. Bertrand , Christopher J. Rozell

We develop a mathematical theory of entropic regularisation of unbalanced optimal transport problems. Focusing on static formulation and relying on the formalism developed for the unregularised case, we show that unbalanced optimal…

Optimization and Control · Mathematics 2023-05-05 Maciej Buze , Manh Hong Duong

The modern convolutional neural networks although achieve great results in solving complex computer vision tasks still cannot be effectively used in mobile and embedded devices due to the strict requirements for computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nikolay Kozyrskiy , Anh-Huy Phan

This article introduces a generalization of the discrete optimal transport, with applications to color image manipulations. This new formulation includes a relaxation of the mass conservation constraint and a regularization term. These two…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Sira Ferradans , Nicolas Papadakis , Gabriel Peyré , Jean-François Aujol