English
Related papers

Related papers: Uncertainty quantification and exploration-exploit…

200 papers

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Fairness in clustering has been considered extensively in the past; however, the trade-off between the two objectives -- e.g., can we sacrifice just a little in the quality of the clustering to significantly increase fairness, or…

Machine Learning · Computer Science 2024-08-20 Rashida Hakim , Ana-Andreea Stoica , Christos H. Papadimitriou , Mihalis Yannakakis

AI Uncertainty Quantification (UQ) has the potential to improve human decision-making beyond AI predictions alone by providing additional probabilistic information to users. The majority of past research on AI and human decision-making has…

Artificial Intelligence · Computer Science 2024-02-07 Laura R. Marusich , Jonathan Z. Bakdash , Yan Zhou , Murat Kantarcioglu

We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is not known in closed…

Machine Learning · Computer Science 2022-03-23 Zhiyuan Jerry Lin , Raul Astudillo , Peter I. Frazier , Eytan Bakshy

Latest research revealed a considerable lack of reliability within user feedback and discussed striking impacts for the assessment of adaptive web systems and content personalisation approaches, e.g. ranking errors, systematic biases to…

Human-Computer Interaction · Computer Science 2018-02-19 Kevin Jasberg , Sergej Sizov

We pose uncertainty quantification and exploration in online decision-making as a problem of training and generation from an autoregressive sequence model, an area experiencing rapid innovation. Our approach rests on viewing uncertainty as…

Machine Learning · Computer Science 2025-02-06 Tiffany Tianhui Cai , Hongseok Namkoong , Daniel Russo , Kelly W Zhang

Planning safe trajectories under model uncertainty is a fundamental challenge. Robust planning ensures safety by considering worst-case realizations, yet ignores uncertainty reduction and leads to overly conservative behavior. Actively…

Robotics · Computer Science 2026-04-20 Kaleb Ben Naveed , Manveer Singh , Devansh R. Agrawal , Dimitra Panagou

A prey animal surveying its environment must decide whether there is a dangerous predator present or not. If there is, it may flee. Flight has an associated cost, so the animal should not flee if there is no danger. However, the prey animal…

Populations and Evolution · Quantitative Biology 2011-04-20 Joel Zylberberg , Michael R. DeWeese

The prevalence and importance of algorithmic two-sided marketplaces has drawn attention to the issue of fairness in such settings. Algorithmic decisions are used in assigning students to schools, users to advertisers, and applicants to job…

Machine Learning · Computer Science 2023-06-19 Siddartha Devic , David Kempe , Vatsal Sharan , Aleksandra Korolova

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

In recent years, learning-based control in robotics has gained significant attention due to its capability to address complex tasks in real-world environments. With the advances in machine learning algorithms and computational capabilities,…

Robotics · Computer Science 2023-05-30 Taekyung Kim , Jungwi Mun , Junwon Seo , Beomsu Kim , Seongil Hong

In many sequential decision-making problems, the goal is to optimize a utility function while satisfying a set of constraints on different utilities. This learning problem is formalized through Constrained Markov Decision Processes (CMDPs).…

Machine Learning · Computer Science 2020-03-05 Yonathan Efroni , Shie Mannor , Matteo Pirotta

Fair predictive algorithms hinge on both equality and trust, yet inherent uncertainty in real-world data challenges our ability to make consistent, fair, and calibrated decisions. While fairly managing predictive error has been extensively…

Machine Learning · Computer Science 2024-10-04 Lucas Rosenblatt , R. Teal Witter

Ensuring the safety of environmental exploration is a critical problem in reinforcement learning (RL). While limiting exploration to a feasible zone has become widely accepted as a way to ensure safety, key questions remain unresolved: what…

Machine Learning · Computer Science 2026-02-05 Yujie Yang , Zhilong Zheng , Shengbo Eben Li

Optimization under uncertainty is important in many applications, particularly to inform policy and decision making in areas such as public health. A key source of uncertainty arises from the incorporation of environmental variables as…

Methodology · Statistics 2024-10-25 Daria Semochkina , Alexander I. J. Forrester , David C Woods

We propose a game-theoretic framework that incorporates both incomplete information and general ambiguity attitudes on factors external to all players. Our starting point is players' preferences on payoff-distribution vectors, essentially…

Economics · Quantitative Finance 2017-04-04 Jian Yang

Individual decision-makers consume information revealed by the previous decision makers, and produce information that may help in future decisions. This phenomenon is common in a wide range of scenarios in the Internet economy, as well as…

Computer Science and Game Theory · Computer Science 2019-05-06 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis

Exploration in unknown environments is a fundamental problem in reinforcement learning and control. In this work, we study task-guided exploration and determine what precisely an agent must learn about their environment in order to complete…

Machine Learning · Computer Science 2021-07-13 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

Quantifying uncertainties in collective human behavior and decision making is crucial for ensuring public health and safety, enabling effective disaster response, informing the design of transportation and communication networks, and…

Physics and Society · Physics 2016-12-02 Kimberly J. Schlesinger , Chantal Nguyen , Imtiaz Ali , Jean M. Carlson

Learning the preferences of a human improves the quality of the interaction with the human. The number of queries available to learn preferences maybe limited especially when interacting with a human, and so active learning is a must. One…

Machine Learning · Computer Science 2020-02-18 Sriram Gopalakrishnan , Utkarsh Soni