English
Related papers

Related papers: When AAA Satisfies Nothing: Impossibility Theorems…

200 papers

In classification with a reject option, the classifier is allowed in uncertain cases to abstain from prediction. The classical cost-based model of a reject option classifier requires the cost of rejection to be defined explicitly. An…

Machine Learning · Computer Science 2021-02-01 V. Franc , D. Prusa , V. Voracek

As artificial agents become increasingly capable, what internal structure is *necessary* for an agent to act competently under uncertainty? Classical results show that optimal control can be *implemented* using belief states or world…

Machine Learning · Computer Science 2026-04-03 Aran Nayebi

Humans are black boxes -- we cannot observe their neural processes, yet society functions by evaluating verifiable arguments. AI explainability should follow this principle: stakeholders need verifiable reasoning chains, not mechanistic…

Machine Learning · Computer Science 2025-10-07 Ege Cakar , Per Ola Kristensson

Scoring models support decision-making in financial institutions. Their estimation and evaluation are based on the data of previously accepted applicants with known repayment behavior. This creates sampling bias: the available labeled data…

This paper demonstrates a methodology for examining the accuracy of uncertain inference systems (UIS), after their parameters have been optimized, and does so for several common UIS's. This methodology may be used to test the accuracy when…

Artificial Intelligence · Computer Science 2013-04-11 Ben P. Wise

Selective regression allows abstention from prediction if the confidence to make an accurate prediction is not sufficient. In general, by allowing a reject option, one expects the performance of a regression model to increase at the cost of…

Machine Learning · Computer Science 2022-07-18 Abhin Shah , Yuheng Bu , Joshua Ka-Wing Lee , Subhro Das , Rameswar Panda , Prasanna Sattigeri , Gregory W. Wornell

When a financial institution declines an application for credit, an adverse action (AA) is said to occur. The applicant is then entitled to an explanation for the negative decision. This paper focuses on credit decisions based on a…

Machine Learning · Statistics 2022-04-27 Vijayan N. Nair , Tianshu Feng , Linwei Hu , Zach Zhang , Jie Chen , Agus Sudjianto

Artificial Intelligence (AI) has been used extensively in automatic decision making in a broad variety of scenarios, ranging from credit ratings for loans to recommendations of movies. Traditional design guidelines for AI models focus…

Artificial Intelligence · Computer Science 2018-09-27 Marisa Vasconcelos , Carlos Cardonha , Bernardo Gonçalves

Given that AI systems are set to play a pivotal role in future decision-making processes, their trustworthiness and reliability are of critical concern. Due to their scale and complexity, modern AI systems resist direct interpretation, and…

Artificial Intelligence · Computer Science 2025-01-03 Binxia Xu , Antonis Bikakis , Daniel Onah , Andreas Vlachidis , Luke Dickens

This position paper argues that standardized item-level benchmark data should become the default infrastructure for AI evaluation. Current evaluations suffer from underspecified item selection, construct misalignment, and poor…

Artificial Intelligence · Computer Science 2026-05-25 Han Jiang , Susu Zhang , Dongyao Zhu , Yuzhuo Bai , Sang T. Truong , Xiaoyuan Yi , Sanmi Koyejo , Xing Xie , Ziang Xiao

Biologically-inspired AI agent frameworks claim reliability benefits through structural guarantees adapted from gene regulatory networks, immune systems, and metabolic control. These claims are rarely tested empirically against simpler…

Quantitative Methods · Quantitative Biology 2026-05-18 Bogdan Banu

We formalize Prescriptive Artificial Intelligence as a distinct paradigm for human-AI decision collaboration in high-stakes environments. Unlike predictive systems optimized for outcome accuracy, prescriptive systems are designed to…

Artificial Intelligence · Computer Science 2026-03-26 Pedro Passos , Patrick Moratori

We study capital requirements for bounded financial positions defined as the minimum amount of capital to invest in a chosen eligible asset targeting a pre-specified acceptability test. We allow for general acceptance sets and general…

Risk Management · Quantitative Finance 2014-01-16 Walter Farkas , Pablo Koch-Medina , Cosimo Munari

An imprecise Bayesian nonparametric approach to system reliability with multiple types of components is developed. This allows modelling partial or imperfect prior knowledge on component failure distributions in a flexible way through…

Methodology · Statistics 2016-09-19 Gero Walter , Louis J. M. Aslett , Frank P. A. Coolen

We study learning dynamics induced by strategic agents who repeatedly play a game with an unknown payoff-relevant parameter. In each step, an information system estimates a belief distribution of the parameter based on the players'…

Systems and Control · Electrical Eng. & Systems 2020-10-20 Manxi Wu , Saurabh Amin , Asuman Ozdaglar

This position paper argues that behavioural assurance, even when carefully designed, is being asked to carry safety claims it cannot verify. AI governance frameworks enacted between 2019 and early 2026 require reviewable evidence of…

Machine Learning · Computer Science 2026-05-15 Pratinav Seth , Vinay Kumar Sankarapu

We derive information-theoretic lower bounds on the Bayes risk and generalization error of realizable machine learning models. In particular, we employ an analysis in which the rate-distortion function of the model parameters bounds the…

Machine Learning · Computer Science 2021-11-09 Matthew Nokleby , Ahmad Beirami

Reinforcement-learned reasoning has powered recent AI leaps on verifiable tasks, including mathematics, code, and structure prediction. The harder bottleneck is evaluative judgment in low-verifiability domains, where no oracle anchors…

Artificial Intelligence · Computer Science 2026-05-15 Ziqin Gong , Ning Li , Huaikang Zhou

In an era characterized by the pervasive integration of artificial intelligence into decision-making processes across diverse industries, the demand for trust has never been more pronounced. This thesis embarks on a comprehensive…

Machine Learning · Statistics 2024-01-18 Alessandro Castelnovo

Artificial intelligence now decides who receives a loan, who is flagged for criminal investigation, and whether an autonomous vehicle brakes in time. Governments have responded: the EU AI Act, the NIST Risk Management Framework, and the…

Artificial Intelligence · Computer Science 2026-04-24 Natan Levy , Gadi Perl