English
Related papers

Related papers: Statistical Tests for Replacing Human Decision Mak…

200 papers

In response to everyday queries, humans explicitly signal uncertainty and offer alternative answers when they are unsure. Machine learning models that output calibrated prediction sets through conformal prediction mimic this human…

Machine Learning · Computer Science 2024-06-11 Jesse C. Cresswell , Yi Sui , Bhargava Kumar , Noël Vouitsis

Automated testing tools typically create test cases that are different from what human testers create. This often makes the tools less effective, the created tests harder to understand, and thus results in tools providing less support to…

Software Engineering · Computer Science 2021-03-09 Eduard Enoiu , Robert Feldt

Decision-making with information displays is a key focus of research in areas like human-AI collaboration and data visualization. However, what constitutes a decision problem, and what is required for an experiment to conclude that…

Human-Computer Interaction · Computer Science 2025-05-05 Jessica Hullman , Alex Kale , Jason Hartline

Machine learning algorithms are increasingly used to assist human decision-making. When the goal of machine assistance is to improve the accuracy of human decisions, it might seem appealing to design ML algorithms that complement human…

Computers and Society · Computer Science 2022-09-09 Nina Grgić-Hlača , Claude Castelluccia , Krishna P. Gummadi

Artificial intelligence (AI) holds great promise for supporting clinical trials, from patient recruitment and endpoint assessment to treatment response prediction. However, deploying AI without safeguards poses significant risks,…

Machine Learning · Computer Science 2025-10-09 Yao Chen , David Ohlssen , Aimee Readie , Gregory Ligozio , Ruvie Martin , Thibaud Coroller

Artificial Intelligence (AI) has already made a huge impact on our current technological trends. Through AI developments, machines are now given power and intelligence to behave and work like human mind. In this research project, we propose…

Computers and Society · Computer Science 2018-08-07 Rida Sara Khan , Asad Ali Zardar , Zeeshan Bhatti

Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current…

Artificial Intelligence · Computer Science 2023-07-04 Gali Noti , Yiling Chen

Optimization is ubiquitous in our daily lives. In the past, (sub-)optimal solutions to any problem have been derived by trial and error, sheer luck, or the expertise of knowledgeable individuals. In our contemporary age, there thankfully…

Neural and Evolutionary Computing · Computer Science 2023-12-07 Raphael Patrick Prager

This paper presents a Bayesian framework for assessing the adequacy of a model without the necessity of explicitly enumerating a specific alternate model. A test statistic is developed for tracking the performance of the model across…

Artificial Intelligence · Computer Science 2013-03-25 Kathryn Blackmond Laskey

This paper presents a non-manual design engineering method based on heuristic search algorithm to search for candidate agents in the solution space which formed by artificial intelligence agents modeled on the base of bionics.Compared with…

Artificial Intelligence · Computer Science 2018-07-30 Zengkun Li

Data-driven artificial intelligence models fed with published scientific findings have been used to create powerful prediction engines for scientific and technological advance, such as the discovery of novel materials with desired…

Artificial Intelligence · Computer Science 2021-04-13 Jamshid Sourati , James Evans

Decision support systems based on prediction sets have proven to be effective at helping human experts solve classification tasks. Rather than providing single-label predictions, these systems provide sets of label predictions constructed…

Machine Learning · Computer Science 2024-11-13 Giovanni De Toni , Nastaran Okati , Suhas Thejaswi , Eleni Straitouri , Manuel Gomez-Rodriguez

Purpose: Artificial intelligence (AI) solutions for medical diagnosis require thorough evaluation to demonstrate that performance is maintained for all patient sub-groups and to ensure that proposed improvements in care will be delivered…

Image and Video Processing · Electrical Eng. & Systems 2022-09-20 Tom Dyer , Jordan Smith , Gaetan Dissez , Nicole Tay , Qaiser Malik , Tom Naunton Morgan , Paul Williams , Liliana Garcia-Mondragon , George Pearse , Simon Rasalingham

Lean processes focus on doing only necessery things in an efficient way. Artificial intelligence and Machine Learning offer new opportunities to optimizing processes. The presented approach demonstrates an improvement of the test process by…

Software Engineering · Computer Science 2019-06-10 Alexander Poth , Quirin Beck , Andreas Riel

A new trend in medicine is the use of algorithms to analyze big datasets, e.g. using everything your phone measures about you for diagnostics or monitoring. However, these algorithms are commonly compared against weak baselines, which may…

Other Computer Science · Computer Science 2018-02-07 Orianna DeMasi , Konrad Kording , Benjamin Recht

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions with specified…

Machine Learning · Computer Science 2025-03-19 Jessica Hullman , Yifan Wu , Dawei Xie , Ziyang Guo , Andrew Gelman

Artificial intelligence (AI) systems increasingly shape how people access health information, make medical decisions, and receive care -- yet epidemiology lacks frameworks for measuring AI exposure or studying its health effects at the…

Other Statistics · Statistics 2026-04-16 Harsh Parikh , Tyler McCormick , Emily Johnson , Leo Hickey , Megan Ranney , Bhramar Mukherjee

The human brain copes with sensory uncertainty in accordance with Bayes' rule. However, it is unknown how the brain makes predictions in the presence of parameter uncertainty. Here, we tested whether and how humans take parameter…

Neurons and Cognition · Quantitative Biology 2020-07-01 Jannes Jegminat , Maya Jastrzebowska , Matt Pachai , Michael Herzog , Jean-Pascal Pfister

Statistical samples, in order to be representative, have to be drawn from a population in a random and unbiased way. Nevertheless, it is common practice in the field of model-based diagnosis to make estimations from (biased) best-first…

Artificial Intelligence · Computer Science 2022-08-05 Patrick Rodler , Fatima Elichanova

Generative Artificial Intelligence is emerging as an important technology, promising to be transformative in many areas. At the same time, generative AI techniques are based on sampling from probabilistic models, and by default, they come…

Artificial Intelligence · Computer Science 2025-09-19 Edgar Dobriban