English
Related papers

Related papers: A regularized Interior Point Method for sparse Opt…

200 papers

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

A numerical method for the solution of the elliptic Monge-Ampere Partial Differential Equation, with boundary conditions corresponding to the Optimal Transportation (OT) problem is presented. A local representation of the OT boundary…

Numerical Analysis · Mathematics 2012-08-27 Jean-David Benamou , Brittany D. Froese , Adam M. Oberman

We demonstrate the relevance of an algorithm called generalized iterative scaling (GIS) or simultaneous multiplicative algebraic reconstruction technique (SMART) and its rescaled block-iterative version (RBI-SMART) in the field of optimal…

Numerical Analysis · Mathematics 2023-05-15 Johannes von Lindheim , Gabriele Steidl

We rephrase Monge's optimal transportation (OT) problem with quadratic cost--via a Monge-Amp\`ere equation--as an infinite-dimensional optimization problem, which is in fact a convex problem when the target is a log-concave measure with…

Numerical Analysis · Mathematics 2017-08-29 Michael Lindsey , Yanir A. Rubinstein

In this paper, we propose a distributed algorithm for solving large-scale separable convex problems using Lagrangian dual decomposition and the interior-point framework. By adding self-concordant barrier terms to the ordinary Lagrangian, we…

Optimization and Control · Mathematics 2013-02-14 I. Necoara , J. A. K. Suykens

In this paper, we propose image restoration models using optimal transport (OT) and total variation regularization. We present theoretical results of the proposed models based on the relations between the dual Lipschitz norm from OT and the…

Numerical Analysis · Mathematics 2025-03-20 Weijia Huang , Zhongyi Huang , Wenli Yang , Wei Zhu

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to…

Machine Learning · Statistics 2021-01-26 Tam Le , Truyen Nguyen

We present an efficient algorithm for regularized optimal transport. In contrast to previous methods, we use the Douglas-Rachford splitting technique to develop an efficient solver that can handle a broad class of regularizers. The…

Machine Learning · Computer Science 2023-05-31 Jacob Lindbäck , Zesen Wang , Mikael Johansson

This paper studies existing direct transcription methods for trajectory optimization applied to robot motion planning. There are diverse alternatives for the implementation of direct transcription. In this study we analyze the effects of…

Optimization and Control · Mathematics 2016-02-29 Diego Pardo , Lukas Möller , Michael Neunert , Alexander W. Winkler , Jonas Buchli

We study the solution of a large-scale transportation problem with an additional constraint on the sparsity of inbound flows. Such problems arise in the management of inventory for online retailers that operate with many order fulfillment…

Optimization and Control · Mathematics 2014-02-12 Annie I. Chen , Stephen C. Graves

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

Sparsity is a highly desired feature in deep neural networks (DNNs) since it ensures numerical efficiency, improves the interpretability of models (due to the smaller number of relevant features), and robustness. For linear models, it is…

Machine Learning · Computer Science 2024-04-01 Augustina C. Amakor , Konstantin Sonntag , Sebastian Peitz

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

Optimal Mass Transport (OMT) is a well studied problem with a variety of applications in a diverse set of fields ranging from Physics to Computer Vision and in particular Statistics and Data Science. Since the original formulation of Monge…

Machine Learning · Computer Science 2021-10-26 Amanpreet Singh , Martin Bauer , Sarang Joshi

In mathematical optimization, second-order Newton's methods generally converge faster than first-order methods, but they require the inverse of the Hessian, hence are computationally expensive. However, we discover that on sparse graphs,…

Machine Learning · Computer Science 2022-05-30 Nima Dehmamy , Csaba Both , Jianzhi Long , Rose Yu

We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum…

Machine Learning · Computer Science 2023-12-18 Ruijie Jiang , Prakash Ishwar , Shuchin Aeron

This article reviews the use of first order convex optimization schemes to solve the discretized dynamic optimal transport problem, initially proposed by Benamou and Brenier. We develop a staggered grid discretization that is well adapted…

Numerical Analysis · Mathematics 2014-02-11 Nicolas Papadakis , Gabriel Peyré , Edouard Oudet

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

Statistics Theory · Mathematics 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero
‹ Prev 1 8 9 10 Next ›