English
Related papers

Related papers: Optimal DR-Submodular Maximization and Application…

200 papers

In this paper, we consider the unconstrained submodular maximization problem. We propose the first algorithm for this problem that achieves a tight $(1/2-\varepsilon)$-approximation guarantee using $\tilde{O}(\varepsilon^{-1})$ adaptive…

Data Structures and Algorithms · Computer Science 2018-11-20 Lin Chen , Moran Feldman , Amin Karbasi

We explore the problems of classification of composite object (images, speech signals) with low number of models per class. We study the question of improving recognition performance for medium-sized database (thousands of classes). The key…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Andrey Savchenko

We consider the subset selection problem for function $f$ with constraint bound $B$ that changes over time. Within the area of submodular optimization, various greedy approaches are commonly used. For dynamic environments we observe that…

Data Structures and Algorithms · Computer Science 2021-10-12 Vahid Roostapour , Aneta Neumann , Frank Neumann , Tobias Friedrich

In the Shortest Common Superstring problem, one needs to find the shortest superstring for a set of strings. This problem is APX-hard, and many approximation algorithms were proposed, with the current best approximation factor of 2.466.…

Data Structures and Algorithms · Computer Science 2024-07-31 Maksim Nikolaev

Kernel-based schemes are state-of-the-art techniques for learning by data. In this work we extend some ideas about kernel-based greedy algorithms to exponential-polynomial splines, whose main drawback consists in possible overfitting and…

Numerical Analysis · Mathematics 2022-10-31 Rosanna Campagna , Stefano De Marchi , Emma Perracchione , Gabriele Santin

This work studies the distributed empirical risk minimization (ERM) problem under differential privacy (DP) constraint. Standard distributed algorithms achieve DP typically by perturbing all local subgradients with noise, leading to…

Optimization and Control · Mathematics 2023-07-04 Changxin Liu , Karl H. Johansson , Yang Shi

Doubly robust (DR) estimation is a crucial technique in causal inference and missing data problems. We propose a novel Propensity score Augmentved Doubly robust (PAD) estimator to enhance the commonly used DR estimator for average treatment…

Methodology · Statistics 2023-04-18 Liangbo Lyu , Molei Liu

Monotone submodular maximization with a knapsack constraint is NP-hard. Various approximation algorithms have been devised to address this optimization problem. In this paper, we revisit the widely known modified greedy algorithm. First, we…

Data Structures and Algorithms · Computer Science 2021-01-14 Jing Tang , Xueyan Tang , Andrew Lim , Kai Han , Chongshou Li , Junsong Yuan

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

We consider maximization of stochastic monotone continuous submodular functions (CSF) with a diminishing return property. Existing algorithms only guarantee the performance \textit{in expectation}, and do not bound the probability of…

Data Structures and Algorithms · Computer Science 2023-03-22 Evan Becker , Jingdong Gao , Ted Zadouri , Baharan Mirzasoleiman

We consider a generic empirical composition optimization problem, where there are empirical averages present both outside and inside nonlinear loss functions. Such a problem is of interest in various machine learning applications, and…

Optimization and Control · Mathematics 2019-11-04 Adithya M. Devraj , Jianshu Chen

Misclassification of binary responses, if ignored, may severely bias the maximum likelihood estimators (MLE) of regression parameters. For such data, a binary regression model incorporating misclassification probabilities is extensively…

Statistics Theory · Mathematics 2020-09-28 Arindam Chatterjee , Tathagata Bandyopadhyay , Sumanta Adhya

Integrating probability and non-probability samples is increasingly important, yet unknown sampling mechanisms in non-probability sources complicate identification and efficient estimation. We develop semiparametric theory for dual-frame…

Methodology · Statistics 2026-01-14 Kosuke Morikawa , Jae Kwang Kim

We provide a communication- and computation-efficient method for distributed submodular optimization in robot mesh networks. Submodularity is a property of diminishing returns that arises in active information gathering such as mapping,…

Robotics · Computer Science 2025-05-29 Zirui Xu , Sandilya Sai Garimella , Vasileios Tzoumas

We consider regression problems with binary weights. Such optimization problems are ubiquitous in quantized learning models and digital communication systems. A natural approach is to optimize the corresponding Lagrangian using variants of…

Machine Learning · Computer Science 2020-12-01 Nisan Chiprut , Amir Globerson , Ami Wiesel

Collective communications are ubiquitous in parallel applications. We present two new algorithms for performing a reduction. The operation associated with our reduction needs to be associative and commutative. The two algorithms are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-18 Bradley R. Lowery , Julien Langou

In many safety-critical settings, probabilistic ML systems have to make predictions subject to algebraic constraints, e.g., predicting the most likely trajectory that does not cross obstacles. These real-world constraints are rarely convex,…

Machine Learning · Computer Science 2026-02-11 Leander Kurscheidt , Gabriele Masina , Roberto Sebastiani , Antonio Vergari

This work studies the non-monotone DR-submodular Maximization over a ground set of $n$ subject to a size constraint $k$. We propose two approximation algorithms for solving this problem named FastDrSub and FastDrSub++. FastDrSub offers an…

Data Structures and Algorithms · Computer Science 2025-11-05 Tan D. Tran , Canh V. Pham

Finding the optimal embedding of networks into low-dimensional hyperbolic spaces is a challenge that received considerable interest in recent years, with several different approaches proposed in the literature. In general, these methods…

Physics and Society · Physics 2024-01-08 Bendegúz Sulyok , Gergely Palla

Minimax optimization plays an important role in many machine learning tasks such as generative adversarial networks (GANs) and adversarial training. Although recently a wide variety of optimization methods have been proposed to solve the…

Optimization and Control · Mathematics 2023-04-24 Feihu Huang , Songcan Chen