English
Related papers

Related papers: Evaluating AI systems under uncertain ground truth…

200 papers

Expert workers make non-trivial decisions with significant implications. Experts' decision accuracy is thus a fundamental aspect of their judgment quality, key to both management and consumers of experts' services. Yet, in many important…

Machine Learning · Computer Science 2021-10-25 Wanxue Dong , Maytal Saar-Tsechansky , Tomer Geva

As causal ground truth is incredibly rare, causal discovery algorithms are commonly only evaluated on simulated data. This is concerning, given that simulations reflect preconceptions about generating processes regarding noise…

Human-in-the-loop validation is essential in safety-critical clinical AI, yet the transition between initial model inference and expert correction is rarely analyzed as a structured signal. We introduce a diagnostic alignment framework in…

Artificial Intelligence · Computer Science 2026-02-27 Dimitrios P. Panagoulias , Evangelia-Aikaterini Tsichrintzi , Georgios Savvidis , Evridiki Tsoureli-Nikita

Paucity of medical data severely limits the generalizability of diagnostic ML models, as the full spectrum of disease variability can not be represented by a small clinical dataset. To address this, diffusion models (DMs) have been…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Janet Wang , Yunbei Zhang , Zhengming Ding , Jihun Hamm

Artificial intelligence (AI) solutions that automatically extract information from digital histology images have shown great promise for improving pathological diagnosis. Prior to routine use, it is important to evaluate their predictive…

Artificial Intelligence (AI) holds the potential to dramatically improve patient care. However, it is not infallible, necessitating human-AI-collaboration to ensure safe implementation. One aspect of AI safety is the models' ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Anna M. Wundram , Christian F. Baumgartner

The increasing integration of artificial intelligence (AI) into medical diagnostics necessitates a critical examination of its ethical and practical implications. While the prioritization of diagnostic accuracy, as advocated by Sabuncu et…

Computers and Society · Computer Science 2025-01-16 Myles Joshua Toledo Tan , Panayiotis V. Benos

Trustworthiness and transparency are essential for the clinical adoption of artificial intelligence (AI) in healthcare and biomedical research. Recent deep research systems aim to accelerate evidence-grounded scientific discovery by…

Artificial intelligence (AI) has revolutionized decision-making processes and systems throughout society and, in particular, has emerged as a significant technology in high-impact scenarios of national interest. Yet, despite AI's impressive…

Machine Learning · Statistics 2024-08-05 Gregory Canal , Vladimir Leung , Philip Sage , Eric Heim , I-Jeng Wang

Facial recognition systems are increasingly deployed in law enforcement and security contexts, where algorithmic decisions can carry significant societal consequences. Despite high reported accuracy, growing evidence demonstrates that such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Khalid Adnan Alsayed

The rapid growth and diversity in service offerings and the ensuing complexity of information technology ecosystems present numerous management challenges (both operational and strategic). Instrumentation and measurement technology is, by…

Software Engineering · Computer Science 2012-06-26 Moises Goldszmidt

AI predictive systems are increasingly embedded in decision making pipelines, shaping high stakes choices once made solely by humans. Yet robust decisions under uncertainty still rely on capabilities that current AI lacks: domain knowledge…

Artificial Intelligence · Computer Science 2025-10-28 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

In the realm of dermatology, the complexity of diagnosing skin conditions manually necessitates the expertise of dermatologists. Accurate identification of various skin ailments, ranging from cancer to inflammatory diseases, is paramount.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sajib Acharjee Dip , Kazi Hasan Ibn Arif , Uddip Acharjee Shuvo , Ishtiaque Ahmed Khan , Na Meng

AI-based systems have achieved high accuracy in skin disease diagnostics but often exhibit biases across demographic groups, leading to inequitable healthcare outcomes and diminished patient trust. Most existing bias mitigation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Gelei Xu , Yuying Duan , Zheyuan Liu , Xueyang Li , Meng Jiang , Michael Lemmon , Wei Jin , Yiyu Shi

Artificial intelligence (AI) holds great promise for supporting clinical trials, from patient recruitment and endpoint assessment to treatment response prediction. However, deploying AI without safeguards poses significant risks,…

Machine Learning · Computer Science 2025-10-09 Yao Chen , David Ohlssen , Aimee Readie , Gregory Ligozio , Ruvie Martin , Thibaud Coroller

The acceleration in the adoption of AI-based automated decision-making systems poses a challenge for evaluating the fairness of algorithmic decisions, especially in the absence of ground truth. When designing interventions, uplift modeling…

Computers and Society · Computer Science 2024-03-20 Serdar Kadioglu , Filip Michalsky

Purpose: Artificial intelligence (AI) solutions for medical diagnosis require thorough evaluation to demonstrate that performance is maintained for all patient sub-groups and to ensure that proposed improvements in care will be delivered…

Image and Video Processing · Electrical Eng. & Systems 2022-09-20 Tom Dyer , Jordan Smith , Gaetan Dissez , Nicole Tay , Qaiser Malik , Tom Naunton Morgan , Paul Williams , Liliana Garcia-Mondragon , George Pearse , Simon Rasalingham

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

Artificial Intelligence (AI) is now firmly at the center of evidence-based medicine. Despite many success stories that edge the path of AI's rise in healthcare, there are comparably many reports of significant shortcomings and unexpected…

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

Machine Learning · Computer Science 2025-01-24 Xiaoyang Wang , Christopher C. Yang
‹ Prev 1 3 4 5 6 7 10 Next ›