English
Related papers

Related papers: Learning Economic Parameters from Revealed Prefere…

200 papers

We study the problem of pure exploration in matching markets under uncertain preferences, where the goal is to identify a stable matching with confidence parameter $\delta$ and minimal sample complexity. Agents learn preferences via…

Computer Science and Game Theory · Computer Science 2025-09-19 Tejas Pagare , Agniv Bandyopadhyay , Sandeep Juneja

Given an incomplete ratings data over a set of users and items, the preference completion problem aims to estimate a personalized total preference order over a subset of the items. In practical settings, a ranked list of top-$k$ items from…

Social and Information Networks · Computer Science 2019-04-16 Shameem A Puthiya Parambath , Nishant Vijayakumar , Sanjay Chawla

In this paper, we consider a multi-attribute decision making problem where the decision maker's (DM's) objective is to maximize the expected utility of outcomes but the true utility function which captures the DM's risk preference is…

Optimization and Control · Mathematics 2023-03-30 Qiong Wu , Sainan Zhang , Wei Wang , Huifu Xu

Computational preference elicitation methods are tools used to learn people's preferences quantitatively in a given context. Recent works on preference elicitation advocate for active learning as an efficient method to iteratively construct…

Human-Computer Interaction · Computer Science 2024-07-29 Vijay Keswani , Vincent Conitzer , Hoda Heidari , Jana Schaich Borg , Walter Sinnott-Armstrong

The complexity of designing reward functions has been a major obstacle to the wide application of deep reinforcement learning (RL) techniques. Describing an agent's desired behaviors and properties can be difficult, even for experts. A new…

Machine Learning · Computer Science 2024-05-09 Wanqi Xue , Bo An , Shuicheng Yan , Zhongwen Xu

Decision maker's preferences are often captured by some choice functions which are used to rank prospects. In this paper, we consider ambiguity in choice functions over a multi-attribute prospect space. Our main result is a robust…

Risk Management · Quantitative Finance 2018-05-21 William B. Haskell , Wenjie Huang , Huifu Xu

Recent literature in the last Maximum Entropy workshop introduced an analogy between cumulative probability distributions and normalized utility functions. Based on this analogy, a utility density function can de defined as the derivative…

Artificial Intelligence · Computer Science 2009-11-10 Ali E. Abbas

It is challenging to quantify numerical preferences for different objectives in a multi-objective decision-making problem. However, the demonstrations of a user are often accessible. We propose an algorithm to infer linear preference…

Artificial Intelligence · Computer Science 2023-04-28 Junlin Lu

Our goal is to extract useful knowledge from demonstrations of behavior in sequential decision-making problems. Although it is well-known that humans commonly engage in risk-sensitive behaviors in the presence of stochasticity, most Inverse…

Machine Learning · Computer Science 2025-05-21 Filippo Lazzati , Alberto Maria Metelli

Learning to rank with implicit feedback is one of the most important tasks in many real-world information systems where the objective is some specific utility, e.g., clicks and revenue. However, we point out that existing methods based on…

Information Retrieval · Computer Science 2020-11-03 Xinyi Dai , Jiawei Hou , Qing Liu , Yunjia Xi , Ruiming Tang , Weinan Zhang , Xiuqiang He , Jun Wang , Yong Yu

Incorporating graph side information into recommender systems has been widely used to better predict ratings, but relatively few works have focused on theoretical guarantees. Ahn et al. (2018) firstly characterized the optimal sample…

Information Theory · Computer Science 2021-09-09 Changhun Jo , Kangwook Lee

In environments with sparse or delayed rewards, reinforcement learning (RL) incurs high sample complexity due to the large number of interactions needed for learning. This limitation has motivated the use of large language models (LLMs) for…

Machine Learning · Computer Science 2026-02-23 Narjes Nourzad , Carlee Joe-Wong

Modern machine learning algorithms, especially deep learning based techniques, typically involve careful hyperparameter tuning to achieve the best performance. Despite the surge of intense interest in practical techniques like Bayesian…

Machine Learning · Computer Science 2025-05-01 Maria-Florina Balcan , Anh Tuan Nguyen , Dravyansh Sharma

Reinforcement learning algorithms struggle on tasks with complex hierarchical dependency structures. Humans and other intelligent agents do not waste time assessing the utility of every high-level action in existence, but instead only…

Machine Learning · Computer Science 2022-03-25 Robby Costales , Shariq Iqbal , Fei Sha

Product bundling is a common selling mechanism used in online retailing. To set profitable bundle prices, the seller needs to learn consumer preferences from the transaction data. When customers purchase bundles or multiple products,…

Machine Learning · Statistics 2022-09-13 Ningyuan Chen , Setareh Farajollahzadeh , Guan Wang

Learning from preference feedback has emerged as an essential step for improving the generation quality and performance of modern language models (LMs). Despite its widespread use, the way preference-based learning is applied varies wildly,…

Computation and Language · Computer Science 2024-10-10 Hamish Ivison , Yizhong Wang , Jiacheng Liu , Zeqiu Wu , Valentina Pyatkin , Nathan Lambert , Noah A. Smith , Yejin Choi , Hannaneh Hajishirzi

To choose between two discrete goods, a consumer pays attention to only those with prices below a threshold. From these, she chooses her most preferred good. We assume consumers in a population have the same preference but may have…

Theoretical Economics · Economics 2025-11-07 Kaushil Patel

We propose a deep learning approach to probabilistic forecasting of macroeconomic and financial time series. Being able to learn complex patterns from a data rich environment, our approach is useful for a decision making that depends on…

General Economics · Economics 2022-04-15 Jozef Barunik , Lubos Hanus

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Pareto front learning is a technique that introduces preference vectors in a neural network to approximate the Pareto front. Previous Pareto front learning methods have demonstrated high performance in approximating simple Pareto fronts.…

Machine Learning · Computer Science 2024-04-15 Rongguang Ye , Lei Chen , Weiduo Liao , Jinyuan Zhang , Hisao Ishibuchi