English
Related papers

Related papers: Submodular Framework for Structured-Sparse Optimal…

200 papers

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

It is often desired that ordinal regression models yield unimodal predictions. However, in many recent works this characteristic is either absent, or implemented using soft targets, which do not guarantee unimodal outputs at inference. In…

Machine Learning · Statistics 2021-11-19 Uri Shaham , Igal Zaidman , Jonathan Svirsky

With the rising importance of large-scale network control, the problem of actuator placement has received increasing attention. Our goal in this paper is to find a set of actuators minimizing the metric that measures the average energy…

Optimization and Control · Mathematics 2021-07-14 Baiwei Guo , Orcun Karaca , Tyler Summers , Maryam Kamgarpour

Optimal transport (OT) naturally arises in a wide range of machine learning applications but may often become the computational bottleneck. Recently, one line of works propose to solve OT approximately by searching the \emph{transport plan}…

Machine Learning · Computer Science 2021-11-15 Weijie Liu , Chao Zhang , Nenggan Zheng , Hui Qian

Unbalanced optimal transport (UOT) provides a flexible way to match or compare nonnegative finite Radon measures. However, UOT requires a predefined ground transport cost, which may misrepresent the data's underlying geometry. Choosing such…

Machine Learning · Statistics 2026-01-09 Emanuele Pardini , Katerina Papagiannouli

Optimal transport (OT) is a framework that can be used to guide the optimal allocation of a limited amount of resources. The classical OT paradigm does not consider malicious attacks in its formulation and thus the designed transport plan…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Jason Hughes , Juntao Chen

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause

Unbalanced optimal transport (UOT) is a natural extension of optimal transport (OT) allowing comparison between measures of different masses. It arises naturally in machine learning by offering a robustness against outliers. The aim of this…

Optimization and Control · Mathematics 2025-10-06 Luca Nenna , Paul Pegon , Louis Tocquec

We consider a class of discrete optimization problems that aim to maximize a submodular objective function subject to a distributed partition matroid constraint. More precisely, we consider a networked scenario in which multiple agents…

Optimization and Control · Mathematics 2020-11-19 Alexander Robey , Arman Adibi , Brent Schlotfeldt , George J. Pappas , Hamed Hassani

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

In this paper, we present a new formulation of unbalanced optimal transport called Dual Regularized Optimal Transport (DROT). We argue that regularizing the dual formulation of optimal transport results in a version of unbalanced optimal…

Computational Geometry · Computer Science 2020-12-08 Rishi Sonthalia , Anna C. Gilbert

Optimal transport (OT) is a powerful framework to compare probability measures, a fundamental task in many statistical and machine learning problems. Substantial advances have been made in designing OT variants which are either…

Machine Learning · Computer Science 2025-02-04 Clément Bonet , Kimia Nadjahi , Thibault Séjourné , Kilian Fatras , Nicolas Courty

This work studies how the introduction of the entropic regularization term in unbalanced Optimal Transport (OT) models may alter their homogeneity with respect to the input measures. We observe that in common settings (including balanced OT…

Optimization and Control · Mathematics 2022-01-07 Théo Lacombe

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

This paper investigates a new learning formulation called structured sparsity, which is a natural extension of the standard sparsity concept in statistical learning and compressive sensing. By allowing arbitrary structures on the feature…

Methodology · Statistics 2009-05-05 Junzhou Huang , Tong Zhang , Dimitris Metaxas

The greedy algorithm for monotone submodular function maximization subject to cardinality constraint is guaranteed to approximate the optimal solution to within a $1-1/e$ factor. Although it is well known that this guarantee is essentially…

Data Structures and Algorithms · Computer Science 2022-02-15 Aviad Rubinstein , Junyao Zhao

We investigate unpaired image inverse problems, a challenging setting where only independent, non-paired sets of noisy measurements and clean target signals are available for training. We propose a novel inverse problem solver based on…

Machine Learning · Computer Science 2026-05-21 Donggyu Lee , Taekyung Lee , Jaewoong Choi

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

We propose TAROT, a targeted data selection framework grounded in optimal transport theory. Previous targeted data selection methods primarily rely on influence-based greedy heuristics to enhance domain-specific performance. While effective…

Machine Learning · Computer Science 2025-07-04 Lan Feng , Fan Nie , Yuejiang Liu , Alexandre Alahi

We present a novel hierarchical framework for optimal transport (OT) using string diagrams, namely string diagrams of optimal transports. This framework reduces complex hierarchical OT problems to standard OT problems, allowing efficient…

Artificial Intelligence · Computer Science 2025-01-28 Kazuki Watanabe , Noboru Isobe