English
Related papers

Related papers: Learning from Stochastically Revealed Preference

200 papers

We present novel, computationally efficient, and differentially private algorithms for two fundamental high-dimensional learning problems: learning a multivariate Gaussian and learning a product distribution over the Boolean hypercube in…

Data Structures and Algorithms · Computer Science 2019-05-31 Gautam Kamath , Jerry Li , Vikrant Singhal , Jonathan Ullman

In this paper the problem of learning appropriate bias for an environment of related tasks is examined from a Bayesian perspective. The environment of related tasks is shown to be naturally modelled by the concept of an {\em objective}…

Machine Learning · Computer Science 2019-11-15 Jonathan Baxter

We model the joint distribution of choice probabilities and decision times in binary choice tasks as the solution to a problem of optimal sequential sampling, where the agent is uncertain of the utility of each action and pays a constant…

Neurons and Cognition · Quantitative Biology 2015-05-14 Drew Fudenberg , Philipp Strack , Tomasz Strzalecki

We pursue an inverse approach to utility theory and consumption & investment problems. Instead of specifying an agent's utility function and deriving her actions, we assume we observe her actions (i.e. her consumption and investment…

Portfolio Management · Quantitative Finance 2015-03-17 Alexander M. G. Cox , David Hobson , Jan Obloj

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

We study the problem of pure exploration in matching markets under uncertain preferences, where the goal is to identify a stable matching with confidence parameter $\delta$ and minimal sample complexity. Agents learn preferences via…

Computer Science and Game Theory · Computer Science 2025-09-19 Tejas Pagare , Agniv Bandyopadhyay , Sandeep Juneja

In supervised learning one wishes to identify a pattern present in a joint distribution $P$, of instances, label pairs, by providing a function $f$ from instances to labels that has low risk $\mathbb{E}_{P}\ell(y,f(x))$. To do so, the…

Machine Learning · Statistics 2015-07-07 Brendan van Rooyen , Robert C. Williamson

We study sequential social learning with endogenous information acquisition when agents have a taste for nonconformity. Each agent observes predecessors' actions, chooses whether to acquire a private signal (and its precision), and then…

Theoretical Economics · Economics 2026-01-05 Georgy Lukyanov , Vasilii Ivanik

Optimization under uncertainty deals with the problem of optimizing stochastic cost functions given some partial information on their inputs. These problems are extremely difficult to solve and yet pervade all areas of technological and…

Statistical Mechanics · Physics 2015-03-13 Fabrizio Altarelli , Alfredo Braunstein , Abolfazl Ramezanpour , Riccardo Zecchina

User preference learning is generally a hard problem. Individual preferences are typically unknown even to users themselves, while the space of choices is infinite. Here we study user preference learning from information-theoretic…

Machine Learning · Computer Science 2023-11-27 Tanya Ignatenko , Kirill Kondrashov , Marco Cox , Bert de Vries

This paper introduces a probabilistic framework to estimate parameters of an acquisition function given observed human behavior that can be modeled as a collection of sample paths from a Bayesian optimization procedure. The methodology…

Human-Computer Interaction · Computer Science 2022-02-04 Nathan Sandholtz , Yohsuke Miyamoto , Luke Bornn , Maurice Smith

Machine teaching is an inverse problem of machine learning that aims at steering the student learner towards its target hypothesis, in which the teacher has already known the student's learning parameters. Previous studies on machine…

Machine Learning · Computer Science 2021-05-31 Xiaofeng Cao , Ivor W. Tsang

In this paper we model the problem of learning preferences of a population as an active learning problem. We propose an algorithm can adaptively choose pairs of items to show to users coming from a heterogeneous population, and use the…

Machine Learning · Statistics 2016-06-23 Aniruddha Bhargava , Ravi Ganti , Robert Nowak

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportional to exponentiated…

Artificial Intelligence · Computer Science 2021-10-07 David Tolpin , Tomer Dobkin

We study two model selection settings in stochastic linear bandits (LB). In the first setting, which we refer to as feature selection, the expected reward of the LB problem is in the linear span of at least one of $M$ feature maps (models).…

Machine Learning · Computer Science 2022-06-20 Ahmadreza Moradipari , Berkay Turan , Yasin Abbasi-Yadkori , Mahnoosh Alizadeh , Mohammad Ghavamzadeh

We develop a principled approach to end-to-end learning in stochastic optimization. First, we show that the standard end-to-end learning algorithm admits a Bayesian interpretation and trains a posterior Bayes action map. Building on the…

Optimization and Control · Mathematics 2023-06-13 Yves Rychener , Daniel Kuhn , Tobias Sutter

We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is not known in closed…

Machine Learning · Computer Science 2022-03-23 Zhiyuan Jerry Lin , Raul Astudillo , Peter I. Frazier , Eytan Bakshy

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

Continual data collection and widespread deployment of machine learning algorithms, particularly the distributed variants, have raised new privacy challenges. In a distributed machine learning scenario, the dataset is stored among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Shripad Gade , Nitin H. Vaidya

We study the problem of learning the preferences of drivers and planners in the context of last mile delivery. Given a data set containing historical decisions and delivery locations, the goal is to capture the implicit preferences of the…

Artificial Intelligence · Computer Science 2022-01-26 Rocsildes Canoy , Victor Bucarey , Yves Molenbruch , Maxime Mulamba , Jayanta Mandi , Tias Guns