English
Related papers

Related papers: Preference-based Teaching

200 papers

Existing observational approaches for learning human preferences, such as inverse reinforcement learning, usually make strong assumptions about the observability of the human's environment. However, in reality, people make many important…

Machine Learning · Statistics 2021-10-29 Cassidy Laidlaw , Stuart Russell

In this short note, we show that the problem of computing the recursive teaching dimension (RTD) for a concept class (given explicitly as input) requires $n^{\Omega(\log n)}$-time, assuming the exponential time hypothesis (ETH). This…

Computational Complexity · Computer Science 2023-07-20 Pasin Manurangsi

We present a preference learning framework for multiple criteria sorting. We consider sorting procedures applying an additive value model with diverse types of marginal value functions (including linear, piecewise-linear, splined, and…

Machine Learning · Computer Science 2019-10-15 Jiapeng Liu , Milosz Kadzinski , Xiuwu Liao , Xiaoxin Mao , Yao Wang

We describe theoretical bounds and a practical algorithm for teaching a model by demonstration in a sequential decision making environment. Unlike previous efforts that have optimized learners that watch a teacher demonstrate a static…

Machine Learning · Computer Science 2012-10-19 Thomas J. Walsh , Sergiu Goschin

This article surveys recent progress in the Bradley-Terry (BT) model and its extensions. We focus on the statistical and computational aspects, with emphasis on the regime in which both the number of objects and the volume of comparisons…

Methodology · Statistics 2026-01-23 Shuxing Fang , Ruijian Han , Yuanhang Luo , Yiming Xu

Learning of user preferences, as represented by, for example, Conditional Preference Networks (CP-nets), has become a core issue in AI research. Recent studies investigate learning of CP-nets from randomly chosen examples or from membership…

Artificial Intelligence · Computer Science 2019-02-06 Eisa Alanazi , Malek Mouhoub , Sandra Zilles

We prove three results on the dimension structure of complexity classes. 1. The Point-to-Set Principle, which has recently been used to prove several new theorems in fractal geometry, has resource-bounded instances. These instances…

Computational Complexity · Computer Science 2021-09-14 Jack H. Lutz , Neil Lutz , Elvira Mayordomo

We consider the problem of preference based reinforcement learning (PbRL), where, unlike traditional reinforcement learning, an agent receives feedback only in terms of a 1 bit (0/1) preference over a trajectory pair instead of absolute…

Machine Learning · Computer Science 2023-02-07 Aldo Pacchiano , Aadirupa Saha , Jonathan Lee

The learning of predictive models for data-driven decision support has been a prevalent topic in many fields. However, construction of models that would capture interactions among input variables is a challenging task. In this paper, we…

Machine Learning · Computer Science 2019-05-22 Jiapeng Liu , Milosz Kadzinski , Xiuwu Liao , Xiaoxin Mao

In traditional machine teaching, a teacher wants to teach a concept to a learner, by means of a finite set of examples, the witness set. But concepts can have many equivalent representations. This redundancy strongly affects the search…

Learning from preference feedback has emerged as an essential step for improving the generation quality and performance of modern language models (LMs). Despite its widespread use, the way preference-based learning is applied varies wildly,…

Computation and Language · Computer Science 2024-10-10 Hamish Ivison , Yizhong Wang , Jiacheng Liu , Zeqiu Wu , Valentina Pyatkin , Nathan Lambert , Noah A. Smith , Yejin Choi , Hannaneh Hajishirzi

We study the classical and parameterized complexity of computing the positive non-clashing teaching dimension of a set of concepts, that is, the smallest number of examples per concept required to successfully teach an intelligent learner…

Computational Complexity · Computer Science 2025-03-12 Robert Ganian , Liana Khazaliya , Fionn Mc Inerney , Mathis Rocton

Preference-based reinforcement learning (RL) provides a framework to train agents using human preferences between two behaviors. However, preference-based RL has been challenging to scale since it requires a large amount of human feedback…

Machine Learning · Computer Science 2023-03-03 Changyeon Kim , Jongjin Park , Jinwoo Shin , Honglak Lee , Pieter Abbeel , Kimin Lee

Pareto front learning is a technique that introduces preference vectors in a neural network to approximate the Pareto front. Previous Pareto front learning methods have demonstrated high performance in approximating simple Pareto fronts.…

Machine Learning · Computer Science 2024-04-15 Rongguang Ye , Lei Chen , Weiduo Liao , Jinyuan Zhang , Hisao Ishibuchi

We explore questions dealing with the learnability of models of choice over time. We present a large class of preference models defined by a structural criterion for which we are able to obtain an exponential improvement over previously…

Computer Science and Game Theory · Computer Science 2018-09-11 Zachary Chase , Siddharth Prasad

Problem-based learning (PBL) is a constructivist learner-centered instructional approach based on the analysis, resolution and discussion of a given problem. It can be applied to any subject, indeed it is especially useful for the teaching…

History and Overview · Mathematics 2011-11-17 Marina Cazzola

In learning-to-rank problems, a privileged feature is one that is available during model training, but not available at test time. Such features naturally arise in merchandised recommendation systems; for instance, "user clicked this item"…

Machine Learning · Computer Science 2022-09-20 Shuo Yang , Sujay Sanghavi , Holakou Rahmanian , Jan Bakus , S. V. N. Vishwanathan

Large Language Models (LLMs) have recently showcased remarkable reasoning abilities. However, larger models often surpass their smaller counterparts in reasoning tasks, posing the challenge of effectively transferring these capabilities…

Computation and Language · Computer Science 2024-01-26 Haorui Wang , Rongzhi Zhang , Yinghao Li , Lingkai Kong , Yuchen Zhuang , Xiusi Chen , Chao Zhang

Preference-based reinforcement learning (PbRL) can enable robots to learn to perform tasks based on an individual's preferences without requiring a hand-crafted reward function. However, existing approaches either assume access to a…

Machine Learning · Computer Science 2024-02-13 Yi Liu , Gaurav Datta , Ellen Novoseller , Daniel S. Brown

We propose a class of Item Response Theory models for items with ordinal polytomous responses, which extends an existing class of multidimensional models for dichotomously-scored items measuring more than one latent trait. In the proposed…

Methodology · Statistics 2012-01-24 Silvia Bacci , Francesco Bartolucci , Michela Gnaldi