English
Related papers

Related papers: Best Subset Binary Prediction

200 papers

In the last twenty-five years (1990-2014), algorithmic advances in integer optimization combined with hardware improvements have resulted in an astonishing 200 billion factor speedup in solving Mixed Integer Optimization (MIO) problems. We…

Methodology · Statistics 2015-07-14 Dimitris Bertsimas , Angela King , Rahul Mazumder

Minimum Bayes Risk (MBR) decoding optimizes output selection by maximizing the expected utility value of an underlying human distribution. While prior work has shown the effectiveness of MBR decoding through empirical evaluation, few…

Computation and Language · Computer Science 2025-06-23 Yuki Ichihara , Yuu Jinnai , Kaito Ariu , Tetsuro Morimura , Eiji Uchibe

Sequential decision problems are often approximately solvable by simulating possible future action sequences. {\em Metalevel} decision procedures have been developed for selecting {\em which} action sequences to simulate, based on…

Artificial Intelligence · Computer Science 2012-07-26 Nicholas Hay , Stuart Russell , David Tolpin , Solomon Eyal Shimony

Binary optimization, a representative subclass of discrete optimization, plays an important role in mathematical optimization and has various applications in computer vision and machine learning. Usually, binary optimization problems are…

Optimization and Control · Mathematics 2021-05-18 Huan Xiong , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

We study the problem of predicting a set or list of options under knapsack constraint. The quality of such lists are evaluated by a submodular reward function that measures both quality and diversity. Similar to DAgger (Ross et al., 2010),…

Machine Learning · Computer Science 2014-03-18 Jiaji Zhou , Stephane Ross , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

The growing interest in explainable artificial intelligence (XAI) for critical decision making motivates the need for interpretable machine learning (ML) models. In fact, due to their structure (especially with small sizes), these models…

Artificial Intelligence · Computer Science 2022-03-23 Hao Hu , Marie-José Huguet , Mohamed Siala

In confirmatory clinical trials with small sample sizes, hypothesis tests based on asymptotic distributions are often not valid and exact non-parametric procedures are applied instead. However, the latter are based on discrete test…

Methodology · Statistics 2018-02-22 Robin Ristl , Dong Xi , Ekkehard Glimm , Martin Posch

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

Computing the variance of a conditional expectation has often been of importance in uncertainty quantification. Sun et al. has introduced an unbiased nested Monte Carlo estimator, which they call $1\frac{1}{2}$-level simulation since the…

Computation · Statistics 2019-12-09 Takashi Goda

We study the problem of incorporating risk while making combinatorial decisions under uncertainty. We formulate a discrete submodular maximization problem for selecting a set using Conditional-Value-at-Risk (CVaR), a risk metric commonly…

Artificial Intelligence · Computer Science 2018-10-30 Lifeng Zhou , Pratap Tokekar

In this article, we propose a new algorithm for supervised learning methods, by which one can both capture the non-linearity in data and also find the best subset model. To produce an enhanced subset of the original variables, an ideal…

Applications · Statistics 2017-01-23 Peyman Tavallali , Marianne Razavi , Sean Brady

We study the problem of maximizing a monotone submodular set function subject to linear packing constraints. An instance of this problem consists of a matrix $A \in [0,1]^{m \times n}$, a vector $b \in [1,\infty)^m$, and a monotone…

Data Structures and Algorithms · Computer Science 2012-05-01 Yossi Azar , Iftah Gamzu

We study the canonical problem of maximizing a stochastic submodular function subject to a cardinality constraint, where the goal is to select a subset from a ground set of items with uncertain individual performances to maximize their…

Data Structures and Algorithms · Computer Science 2019-05-10 Shreyas Sekar , Milan Vojnovic , Se-Young Yun

In this paper, we propose a novel factor-augmented forecasting regression model with a binary response variable. We develop a maximum likelihood estimation method for the regression parameters and establish the asymptotic properties of the…

Econometrics · Economics 2025-07-23 Tingting Cheng , Jiachen Cong , Fei Liu , Xuanbin Yang

Scenario decision making offers a flexible way of making decision in an uncertain environment while obtaining probabilistic guarantees on the risk of failure of the decision. The idea of this approach is to draw samples of the uncertainty…

Optimization and Control · Mathematics 2025-09-03 Guillaume O. Berger

This paper considers the stochastic convex composite optimization problem and presents multi-cut stochastic approximation (SA) methods for solving it, whose models in expectation overestimate its objective function. The multi-cut model…

Optimization and Control · Mathematics 2026-03-03 Jiaming Liang , Renato D. C. Monteiro , Honghao Zhang

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

We investigate two new optimization problems -- minimizing a submodular function subject to a submodular lower bound constraint (submodular cover) and maximizing a submodular function subject to a submodular upper bound constraint…

Data Structures and Algorithms · Computer Science 2013-11-12 Rishabh Iyer , Jeff Bilmes

We develop a novel procedure for estimating the optimizer of general convex stochastic optimization problems of the form $\min_{x\in\mathcal{X}} \mathbb{E}[F(x,\xi)]$, when the given data is a finite independent sample selected according to…

Statistics Theory · Mathematics 2022-01-26 Daniel Bartl , Shahar Mendelson

Efficient methods to provide sub-optimal solutions to non-convex optimization problems with knowledge of the solution's sub-optimality would facilitate the widespread application of nonlinear optimal control algorithms. To that end,…

Optimization and Control · Mathematics 2023-04-10 Prithvi Akella , Aaron D. Ames