English
Related papers

Related papers: Contextual Ranking and Selection with Gaussian Pro…

200 papers

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

In large scale collective decision making, social choice is a normative study of how one ought to design a protocol for reaching consensus. However, in instances where the underlying decision space is too large or complex for ordinal…

Computer Science and Game Theory · Computer Science 2017-10-03 Brandon Fain , Ashish Goel , Kamesh Munagala , Sukolsak Sakshuwong

Group Relative Policy Optimization (GRPO) has emerged as an effective method for training reasoning models. While it computes advantages based on group mean, GRPO treats each output as an independent sample during the optimization and…

Artificial Intelligence · Computer Science 2026-03-16 Yu Li , Tian Lan , Zhengling Qi

Many functions have approximately-known upper and/or lower bounds, potentially aiding the modeling of such functions. In this paper, we introduce Gaussian process models for functions where such bounds are (approximately) known. More…

Machine Learning · Computer Science 2022-10-20 Vu Nguyen , Marc Peter Deisenroth , Michael A. Osborne

We explore the fundamental problem of sorting through the lens of learning-augmented algorithms, where algorithms can leverage possibly erroneous predictions to improve their efficiency. We consider two different settings: In the first…

Data Structures and Algorithms · Computer Science 2023-11-03 Xingjian Bai , Christian Coester

Hard optimization problems are often approached by finding approximate solutions. Here, we highlight the concept of proportional sampling and discuss how it can be used to improve the performance of stochastic algorithms for optimization.…

Quantum Physics · Physics 2018-08-01 Juan Miguel Arrazola , Thomas R. Bromley , Patrick Rebentrost

A central problem in sequential decision making is to develop algorithms that are practical and computationally efficient, yet support the use of flexible, general-purpose models. Focusing on the contextual bandit problem, recent progress…

Machine Learning · Computer Science 2022-07-14 Yinglun Zhu , Dylan J. Foster , John Langford , Paul Mineiro

Motivated by online platforms such as job markets, we study an agent choosing from a list of candidates, each with a hidden quality that determines match value. The agent observes only a noisy ranking of the candidates plus a binary signal…

Computer Science and Game Theory · Computer Science 2026-02-26 Kate Donahue , Nicole Immorlica , Brendan Lucier

In this paper, we study the learning problem in contextual search, which is motivated by applications such as first-price auction, personalized medicine experiments, and feature-based pricing experiments. In particular, for a sequence of…

Machine Learning · Statistics 2022-07-12 Xi Chen , Quanquan Liu , Yining Wang

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

Datasets in the fields of climate and environment are often very large and irregularly spaced. To model such datasets, the widely used Gaussian process models in spatial statis- tics face tremendous challenges due to the prohibitive…

Methodology · Statistics 2016-05-31 Huang Huang , Ying Sun

There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of what we can extract from valuable data. The state of the art…

Statistics Theory · Mathematics 2023-11-22 Trung Dang , Jasper C. H. Lee , Maoyuan Song , Paul Valiant

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

Machine Learning · Computer Science 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä

Gaussian Process based Bayesian Optimization is a well-known sample efficient sequential strategy for globally optimizing black-box, expensive, and multi-extremal functions. The role of the Gaussian Process is to provide a probabilistic…

Machine Learning · Computer Science 2023-05-16 Antonio Candelieri

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

Large language models have demonstrated surprising ability to perform in-context learning, i.e., these models can be directly applied to solve numerous downstream tasks by conditioning on a prompt constructed by a few input-output examples.…

Computation and Language · Computer Science 2023-04-03 Huan Ma , Changqing Zhang , Yatao Bian , Lemao Liu , Zhirui Zhang , Peilin Zhao , Shu Zhang , Huazhu Fu , Qinghua Hu , Bingzhe Wu

Selecting from or ranking a set of candidates variables in terms of their capacity for predicting an outcome of interest is an important task in many scientific fields. A variety of methods for variable selection and ranking have been…

Methodology · Statistics 2023-08-23 Zhou Tang , Ted Westling

We conduct a study of graphical models and discuss the quality of model selection approximation by formulating the problem as a detection problem and examining the area under the curve (AUC). We are specifically looking at the model…

Information Theory · Computer Science 2016-08-26 Navid Tafaghodi Khajavi , Anthony Kuh

There are so many models in the literature that it is difficult for practitioners to decide which combinations are likely to be effective for a new task. This paper attempts to address this question by capturing relationships among…

Artificial Intelligence · Computer Science 2021-11-08 Jiaji Huang , Qiang Qiu , Kenneth Church

We study sequential decision making in environments where rewards are only partially observed, but can be modeled as a function of observed contexts and the chosen action by the decision maker. This setting, known as contextual bandits,…

Methodology · Statistics 2015-03-11 Miroslav Dudík , Dumitru Erhan , John Langford , Lihong Li