English
Related papers

Related papers: Contextual Ranking and Selection with Gaussian Pro…

200 papers

In this paper, the problem of maximizing a black-box function $f:\mathcal{X} \to \mathbb{R}$ is studied in the Bayesian framework with a Gaussian Process (GP) prior. In particular, a new algorithm for this problem is proposed, and high…

Machine Learning · Statistics 2018-01-09 Shubhanshu Shekhar , Tara Javidi

Bayesian optimisation requires fitting a Gaussian process model, which in turn requires specifying prior on the unknown black-box function -- most of the theoretical literature assumes this prior is known. However, it is common to have more…

Machine Learning · Computer Science 2025-02-25 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

Sequence optimization, where the items in a list are ordered to maximize some reward has many applications such as web advertisement placement, search, and control libraries in robotics. Previous work in sequence optimization produces a…

Artificial Intelligence · Computer Science 2012-02-10 Debadeepta Dey , Tian Yu Liu , Martial Hebert , J. Andrew Bagnell

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

The problem of ranking/ordering instances, instead of simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the ranking problem in a rigorous statistical framework. The goal is to learn…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Gábor Lugosi , Nicolas Vayatis

In this paper, we propose how to use objective arguments grounded in statistical mechanics concepts in order to obtain a single number, obtained after aggregation, which would allow to rank "agents", "opinions", ..., all defined in a very…

Physics and Society · Physics 2024-05-02 Marcel Ausloos , Giulia Rotundo , Roy Cerqueti

Several strategies have been developed recently to ensure valid inference after model selection; some of these are easy to compute, while others fare better in terms of inferential power. In this paper, we consider a selective inference…

Methodology · Statistics 2022-07-13 Snigdha Panigrahi , Jonathan Taylor

Classification bandits are multi-armed bandit problems whose task is to classify a given set of arms into either positive or negative class depending on whether the rate of the arms with the expected reward of at least h is not less than w…

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with…

Machine Learning · Statistics 2011-12-30 Neil Houlsby , Ferenc Huszár , Zoubin Ghahramani , Máté Lengyel

In this paper, we consider large-scale ranking problems where one is given a set of (possibly non-redundant) pairwise comparisons and the underlying ranking explained by those comparisons is desired. We show that stochastic gradient descent…

Optimization and Control · Mathematics 2024-07-04 Benjamin Jarman , Lara Kassab , Deanna Needell , Alexander Sietsema

Ranking, and inferences based on ranking of a set of entities, are important problems in numerous contexts. This is especially true in small area statistics where there may be only a limited amount of directly observed data from each entity…

Methodology · Statistics 2025-11-26 Snigdhansu Chatterjee , Gauri Sankar Datta , Yiren Hou , Abhyuday Mandal

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin

The goal of ranking and selection (R&S) procedures is to identify the best stochastic system from among a finite set of competing alternatives. Such procedures require constructing estimates of each system's performance, which can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-17 Eric C. Ni , Dragos F. Ciocan , Shane G. Henderson , Susan R. Hunter

In consumer theory, ranking available objects by means of preference relations yields the most common description of individual choices. However, preference-based models assume that individuals: (1) give their preferences only between pairs…

Machine Learning · Computer Science 2023-02-02 Alessio Benavoli , Dario Azzimonti , Dario Piga

Feature selection is a crucial tool in machine learning and is widely applied across various scientific disciplines. Traditional supervised methods generally identify a universal set of informative features for the entire population.…

Machine Learning · Computer Science 2024-06-11 Ram Dyuthi Sristi , Ofir Lindenbaum , Shira Lifshitz , Maria Lavzin , Jackie Schiller , Gal Mishne , Hadas Benisty

Motivated by the need for rigorous and scalable evaluation of large language models, we study contextual preference inference for pairwise comparison functionals of context-dependent preference score functions across domains. Focusing on…

Machine Learning · Statistics 2025-09-09 Yichi Zhang , Alexander Belloni , Ethan X. Fang , Junwei Lu , Xiaoan Xu

We consider a general class of regression models with normally distributed covariates, and the associated nonconvex problem of fitting these models from data. We develop a general recipe for analyzing the convergence of iterative algorithms…

Optimization and Control · Mathematics 2021-09-22 Kabir Aladin Chandrasekher , Ashwin Pananjady , Christos Thrampoulidis

We develop a method for the evaluation of extreme event statistics associated with nonlinear dynamical systems, using a small number of samples. From an initial dataset of design points, we formulate a sequential strategy that provides the…

Machine Learning · Computer Science 2022-06-08 Mustafa A. Mohamad , Themistoklis P. Sapsis

Suppose there is a large collection of items, each with an associated cost and an inherent utility that is revealed only once we commit to selecting it. Given a budget on the cumulative cost of the selected items, how can we pick a subset…

Machine Learning · Computer Science 2015-06-08 Hastagiri P. Vanchinathan , Andreas Marfurt , Charles-Antoine Robelin , Donald Kossmann , Andreas Krause

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak