English
Related papers

Related papers: Value of agreement in decision analysis: Concept, …

200 papers

"How much is my data worth?" is an increasingly common question posed by organizations and individuals alike. An answer to this question could allow, for instance, fairly distributing profits among multiple data contributors and determining…

Machine Learning · Computer Science 2023-03-07 Ruoxi Jia , David Dao , Boxin Wang , Frances Ann Hubis , Nick Hynes , Nezihe Merve Gurel , Bo Li , Ce Zhang , Dawn Song , Costas Spanos

In consumer search, there is a set of items. An agent has a prior over her value for each item and can pay a cost to learn the instantiation of her value. After exploring a subset of items, the agent chooses one and obtains a payoff equal…

Computer Science and Game Theory · Computer Science 2019-05-15 Nicole Immorlica , Jieming Mao , Christos Tzamos

Modeling the preferences of agents over a set of alternatives is a principal concern in many areas. The dominant approach has been to find a single reward/utility function with the property that alternatives yielding higher rewards are…

Machine Learning · Computer Science 2022-06-09 Alihan Hüyük , William R. Zame , Mihaela van der Schaar

Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Given the impact of these decisions on individuals, organizations, and population groups, it is essential to understand…

Artificial Intelligence · Computer Science 2025-07-29 Venetia Pliatsika , Joao Fonseca , Kateryna Akhynko , Ivan Shevchenko , Julia Stoyanovich

I study the optimal design of ratings to motivate agent investment in quality when transfers are unavailable. The principal designs a rating scheme that maps the agent's quality to a (possibly stochastic) score. The agent has private…

Theoretical Economics · Economics 2025-08-11 Peiran Xiao

The main contribution of this paper is the development of a new decision tree algorithm. The proposed approach allows users to guide the algorithm through the data partitioning process. We believe this feature has many applications but in…

Machine Learning · Statistics 2020-10-27 Cédric Beaulac , Jeffrey S. Rosenthal

Measuring inter-annotator agreement is important for annotation tasks, but many metrics require a fully-annotated set of data, where all annotators annotate all samples. We define Sparse Probability of Agreement, SPA, which estimates the…

Computation and Language · Computer Science 2023-02-28 Jeppe Nørregaard , Leon Derczynski

When machine learning supports decision-making in safety-critical systems, it is important to verify and understand the reasons why a particular output is produced. Although feature importance calculation approaches assist in…

Machine Learning · Statistics 2020-09-14 Divish Rengasamy , Benjamin Rothwell , Grazziela Figueredo

Decision trees are widely used for interpretable machine learning due to their clearly structured reasoning process. However, this structure belies a challenge we refer to as predictive equivalence: a given tree's decision boundary can be…

Machine Learning · Computer Science 2025-10-15 Hayden McTavish , Zachery Boner , Jon Donnelly , Margo Seltzer , Cynthia Rudin

This paper studies a decentralized many-to-one matching market where preferences remain uncertain during the matching process. Institutions initiate matching by sending offers, and applicants decide whether to accept upon receiving them.…

Theoretical Economics · Economics 2025-11-14 Yu-Ting Ho

When comparing performance (of products, services, entities, etc.), multiple attributes are involved. This paper deals with a way of weighting these attributes when one is seeking an overall score. It presents an objective approach to…

Methodology · Statistics 2024-09-04 Chris Tofallis

Strategic behavior is a fundamental problem in a variety of real-world applications that require some form of peer assessment, such as peer grading of homeworks, grant proposal review, conference peer review of scientific papers, and peer…

Computer Science and Game Theory · Computer Science 2022-08-30 Komal Dhull , Steven Jecmen , Pravesh Kothari , Nihar B. Shah

This note explores probabilistic sampling weighted by uncertainty in active learning. This method has been previously used and authors have tangentially remarked on its efficacy. The scheme has several benefits: (1) it is computationally…

Machine Learning · Computer Science 2019-09-12 Vinay Jethava

In the peer selection problem a group of agents must select a subset of themselves as winners for, e.g., peer-reviewed grants or prizes. Here, we take a Condorcet view of this aggregation problem, i.e., that there is a ground-truth ordering…

Computer Science and Game Theory · Computer Science 2021-07-22 Omer Lev , Nicholas Mattei , Paolo Turrini , Stanislav Zhydkov

We examine a controlled school choice model where students are categorized into different types, and the distribution of these types within a school influences its priority structure. This study provides a general framework that integrates…

Theoretical Economics · Economics 2025-03-25 Minoru Kitahara , Yasunori Okumura

Our society is governed by a set of norms which together bring about the values we cherish such as safety, fairness or trustworthiness. The goal of value-alignment is to create agents that not only do their tasks but through their…

Artificial Intelligence · Computer Science 2025-05-22 Kryspin Varys , Federico Cerutti , Adam Sobey , Timothy J. Norman

We propose a novel and efficient algorithm for the collaborative preference completion problem, which involves jointly estimating individualized rankings for a set of entities over a shared set of items, based on a limited number of…

Machine Learning · Statistics 2016-11-16 Suriya Gunasekar , Oluwasanmi Koyejo , Joydeep Ghosh

Effort Estimation has always been a challenging task for the Project managers. Many researchers have tried to help them by creating different types of models. This has been already proved that none is successful for all types of projects…

Software Engineering · Computer Science 2013-10-22 Sumeet Kaur Sehra , Dr. Yadwinder Singh Brar , Dr. Navdeep Kaur

Predictive process monitoring has recently gained traction in academia and is maturing also in companies. However, with the growing body of research, it might be daunting for companies to navigate in this domain in order to find, provided…

Artificial Intelligence · Computer Science 2025-07-22 Chiara Di Francescomarino , Chiara Ghidini , Fabrizio Maria Maggi , Fredrik Milani

Multiple importance sampling (MIS) methods use a set of proposal distributions from which samples are drawn. Each sample is then assigned an importance weight that can be obtained according to different strategies. This work is motivated by…

Computation · Statistics 2015-05-21 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo