English
Related papers

Related papers: Generalized Iterative Scaling for Regularized Opti…

200 papers

Linear inverse problems are very common in signal and image processing. Many algorithms that aim at solving such problems include unknown parameters that need tuning. In this work we focus on optimally selecting such parameters in iterative…

Computer Vision and Pattern Recognition · Computer Science 2010-03-23 Raja Giryes , Michael Elad , Yonina C Eldar

Developing a contemporary optimal transport (OT) solver requires navigating trade-offs among several critical requirements: GPU parallelization, scalability to high-dimensional problems, theoretical convergence guarantees, empirical…

Machine Learning · Computer Science 2025-04-04 Mete Kemertas , Amir-massoud Farahmand , Allan D. Jepson

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment provide interpretable geometric frameworks for comparing, transforming, and aggregating heterogeneous datasets -- tasks ubiquitous in data science and machine learning. Because…

Machine Learning · Computer Science 2025-12-04 Sanjit Dandapanthula , Aleksandr Podkopaev , Shiva Prasad Kasiviswanathan , Aaditya Ramdas , Ziv Goldfeld

In stochastic optimization, the population risk is generally approximated by the empirical risk. However, in the large-scale setting, minimization of the empirical risk may be computationally restrictive. In this paper, we design an…

Machine Learning · Statistics 2016-11-22 Murat A. Erdogdu , Mohsen Bayati , Lee H. Dicker

In this short expository note, we describe a unified algorithmic perspective on several classical problems which have traditionally been studied in different communities. This perspective views the main characters -- the problems of Optimal…

Optimization and Control · Mathematics 2022-11-01 Jason M. Altschuler

Multi-objective search (MOS) has become essential in robotics, as real-world robotic systems need to simultaneously balance multiple, often conflicting objectives. Recent works explore complex interactions between objectives, leading to…

Artificial Intelligence · Computer Science 2025-09-29 Hadar Peer , Eyal Weiss , Ron Alterovitz , Oren Salzman

In this paper, we consider the algorithms and convergence for a general optimization problem, which has a wide range of applications in image segmentation, topology optimization, flow network formulation, and surface reconstruction. In…

Optimization and Control · Mathematics 2024-03-15 Dong Wang , Shangzhi Zeng , Jin Zhang

3D Gaussian Splatting (3DGS) has recently gained significant attention for high-quality and efficient view synthesis, making it widely adopted in fields such as AR/VR, robotics, and autonomous driving. Despite its impressive algorithmic…

Inverse optimization has received much attention in recent years, but little literature exists for solving generalized mixed integer inverse optimization. We propose a new approach for solving generalized mixed-integer inverse optimization…

Optimization and Control · Mathematics 2024-06-17 Ari J. Smith , Justin J. Boutilier

Optimal transportation provides a means of lifting distances between points on a geometric domain to distances between signals over the domain, expressed as probability distributions. On a graph, transportation problems can be used to…

Optimization and Control · Mathematics 2018-03-26 Montacer Essid , Justin Solomon

Generalized alternating projections is an algorithm that alternates relaxed projections onto a finite number of sets to find a point in their intersection. We consider the special case of two linear subspaces, for which the algorithm…

Optimization and Control · Mathematics 2017-03-31 Mattias Fält , Pontus Giselsson

In this paper we investigate all-at-once versus reduced regularization of dynamic inverse problems on finite time intervals $(0,T)$. In doing so, we concentrate on iterative methods and nonlinear problems, since they have already been shown…

Numerical Analysis · Mathematics 2019-10-16 Barbara Kaltenbacher

Nowadays, the Internet of Things (IoT) has become one of the most important technologies which enables a variety of connected and intelligent applications in smart cities. The smart decision making process of IoT devices not only relies on…

Machine Learning · Computer Science 2022-10-17 Hongde Wu

While the optimal transport (OT) problem was originally formulated as a linear program, the addition of entropic regularization has proven beneficial both computationally and statistically, for many applications. The Sinkhorn fixed-point…

Machine Learning · Statistics 2023-04-06 James Thornton , Marco Cuturi

Standard gradient-based iteration algorithms for optimization, such as gradient descent and its various proximal-based extensions to nonsmooth problems, are known to converge slowly for ill-conditioned problems, sometimes requiring many…

Numerical Analysis · Mathematics 2026-03-24 G. H. M. Araújo , O. A. Krzysik , H. De Sterck

Optimal transport (OT) has enjoyed great success in machine learning as a principled way to align datasets via a least-cost correspondence, driven in large part by the runtime efficiency of the Sinkhorn algorithm (Cuturi, 2013). However,…

Machine Learning · Computer Science 2025-08-19 Peter Halmos , Julian Gold , Xinhao Liu , Benjamin J. Raphael

Optimal Transport (OT) has recently emerged as a powerful framework for learning minimal-displacement maps between distributions. The predominant approach involves a neural parametrization of the Monge formulation of OT, typically assuming…

Machine Learning · Computer Science 2024-07-23 Athina Sotiropoulou , David Alvarez-Melis

Many problems in machine learning involve calculating correspondences between sets of objects, such as point clouds or images. Discrete optimal transport provides a natural and successful approach to such tasks whenever the two sets of…

Machine Learning · Statistics 2019-02-28 David Alvarez-Melis , Stefanie Jegelka , Tommi S. Jaakkola

For nonlinear multispectral computed tomography (CT), accurate and fast image reconstruction is challenging when the scanning geometries under different X-ray energy spectra are inconsistent or mismatched. Motivated by this, we propose an…

Numerical Analysis · Mathematics 2025-07-28 Yu Gao , Chong Chen

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower