English
Related papers

Related papers: Marginal minimization and sup-norm expansions in p…

200 papers

We study a general class of convex submodular optimization problems with indicator variables. Many applications such as the problem of inferring Markov random fields (MRFs) with a sparsity or robustness prior can be naturally modeled in…

Optimization and Control · Mathematics 2025-07-08 Andres Gomez , Shaoning Han

We consider convex stochastic optimization problems under different assumptions on the properties of available stochastic subgradient. It is known that, if the value of the objective function is available, one can obtain, in parallel,…

Optimization and Control · Mathematics 2017-01-19 Pavel Dvurechensky , Alexander Gasnikov , Anastasia Lagunovskaya

In this work, we study the Stochastic Budgeted Multi-round Submodular Maximization (SBMSm) problem, where we aim to adaptively maximize the sum, over multiple rounds, of a monotone and submodular objective function defined on subsets of…

Data Structures and Algorithms · Computer Science 2024-09-26 Vincenzo Auletta , Diodato Ferraioli , Cosimo Vinci

This article describes posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization. We then show that fitted parameters can be used as the basis for a novel…

Applications · Statistics 2011-12-30 Matthew A. Taddy

Many important problems in discrete optimization require maximization of a monotonic submodular function subject to matroid constraints. For these problems, a simple greedy algorithm is guaranteed to obtain near-optimal solutions. In this…

Data Structures and Algorithms · Computer Science 2015-03-17 Daniel Golovin , Andreas Krause

We show that any submodular minimization (SM) problem defined on a linear constraint set with constraints having up to two variables per inequality, are 2-approximable in polynomial time. If the constraints are monotone (the two variables…

Discrete Mathematics · Computer Science 2017-05-01 Dorit S. Hochbaum

Motivated by the need for, and growing interest in, modeling uncertainty in data, we introduce and study {\em stochastic minimum-norm optimization}. We have an underlying combinatorial optimization problem where the costs involved are {\em…

Data Structures and Algorithms · Computer Science 2020-11-04 Sharat Ibrahimpur , Chaitanya Swamy

The inferential models (IM) framework provides prior-free, frequency-calibrated, posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown…

Statistics Theory · Mathematics 2016-01-26 Ryan Martin , Chuanhai Liu

Optimization problems involving mixed variables (i.e., variables of numerical and categorical nature) can be challenging to solve, especially in the presence of mixed-variable constraints. Moreover, when the objective function is the result…

Optimization and Control · Mathematics 2024-12-12 Mengjia Zhu , Alberto Bemporad

We study the problem of learning a partially observed matrix under the low rank assumption in the presence of fully observed side information that depends linearly on the true underlying matrix. This problem consists of an important…

Machine Learning · Statistics 2026-02-05 Dimitris Bertsimas , Nicholas A. G. Johnson

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

In this work, we study a new approach to optimizing the margin distribution realized by binary classifiers. The classical approach to this problem is simply maximization of the expected margin, while more recent proposals consider…

Machine Learning · Statistics 2018-10-12 Matthew J. Holland

In this paper we present a simple partitioning based technique to refine the statistical analysis of classification algorithms. The core of our idea is to divide the input space into two parts such that the first part contains a suitable…

Statistics Theory · Mathematics 2018-03-06 Ingrid Blaschzyk , Ingo Steinwart

We study a stochastic variant of monotone submodular maximization problem as follows. We are given a monotone submodular function as an objective function and a feasible domain defined on a finite set, and our goal is to find a feasible…

Data Structures and Algorithms · Computer Science 2020-06-29 Takanori Maehara , Yutaro Yamaguchi

Finding diverse solutions to optimization problems has been of practical interest for several decades, and recently enjoyed increasing attention in research. While submodular optimization has been rigorously studied in many fields, its…

Data Structures and Algorithms · Computer Science 2023-07-18 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

This paper deals with the scenario approach to robust optimization. This relies on a random sampling of the possibly infinite number of constraints induced by uncertainties in the parameters of an optimization problem. Solving the resulting…

Optimization and Control · Mathematics 2023-03-08 Fabien Lauer

In this paper, we study the predict-then-optimize problem where the output of a machine learning prediction task is used as the input of some downstream optimization problem, say, the objective coefficient vector of a linear program. The…

Machine Learning · Computer Science 2023-05-30 Chunlin Sun , Shang Liu , Xiaocheng Li

We study the problem of bounding path-dependent expectations (within any finite time horizon $d$) over the class of discrete-time martingales whose marginal distributions lie within a prescribed tolerance of a given collection of benchmark…

Probability · Mathematics 2021-12-01 Zhengqing Zhou , Jose Blanchet , Peter W. Glynn

We consider the semi-infinite optimization problem: $f^*:=\min_{x\in X}\:\{f(x): g(x,y)\,\leq \,0,\:\forally\in Y_x\}$, where $f,g$ are polynomials and $X\subset R^n$ as well as $Y_\x\subset R^p$, $x\in X$, are compact basic semi-algebraic…

Optimization and Control · Mathematics 2011-01-24 Jean Lasserre

The goal of a typical adaptive sequential decision making problem is to design an interactive policy that selects a group of items sequentially, based on some partial observations, to maximize the expected utility. It has been shown that…

Machine Learning · Computer Science 2021-11-02 Shaojie Tang , Jing Yuan