English
Related papers

Related papers: Claim-Selective Certification for High-Risk Medica…

200 papers

Hybrid controlled trials (HCTs), which augment randomized controlled trials (RCTs) with external controls (ECs), are increasingly receiving attention as a way to address limited power, slow accrual, and ethical concerns in clinical…

Methodology · Statistics 2025-05-02 Jiajun Liu , Ke Zhu , Shu Yang , Xiaofei Wang

Medical RAG needs evidence-grounded claims, so plugging a claim-level NLI checker into retrieval-augmented RL is intuitive. \textbf{We find that the checker's \emph{output distribution} during training, not its held-out accuracy, decides…

Computation and Language · Computer Science 2026-05-26 Yuelyu Ji , Min Gu Kwak , Hang Zhang , Xizhi Wu , Chenyu Li , Yanshan Wan

Can democratized information gatekeepers and community note writers effectively decide what scientific information to amplify? Lacking domain expertise, such gatekeepers rely on automated reasoning agents that use RAG to ground evidence to…

Information Retrieval · Computer Science 2025-12-08 Shubham Mohole , Hongjun Choi , Shusen Liu , Christine Klymko , Shashank Kushwaha , Derek Shi , Wesam Sakla , Sainyam Galhotra , Ruben Glatt

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Large language models increasingly fail in a way that scalar accuracy cannot diagnose: they produce a sound reasoning trace and then abandon it under social pressure or an authoritative hint. We argue that this is a control failure, not a…

Artificial Intelligence · Computer Science 2026-04-09 Edward Y. Chang

Evaluating multi-paragraph clinical question answering (QA) systems is resource-intensive and challenging: accurate judgments require medical expertise and achieving consistent human judgments over multi-paragraph text is difficult. We…

Computation and Language · Computer Science 2026-04-06 Federica Bologna , Tiffany Pan , Matthew Wilkens , Yue Guo , Lucy Lu Wang

Predicting T-cell receptor (TCR)--peptide-MHC (pMHC) binding is central to vaccine design and T-cell therapy, yet deployed models frequently encounter epitopes unseen during training, causing silent overconfidence and unreliable…

Graphics · Computer Science 2026-04-16 Arman Bekov , Timur Bekzhanov , Bekzat Sadykov

Large sets of unlabelled data within the healthcare domain remain underutilized. Active learning offers a way to exploit these datasets by iteratively requesting an oracle (e.g. medical professional) to label instances. This process, which…

Machine Learning · Computer Science 2020-04-23 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Recent machine learning papers often report 1-2 percentage point improvements from a single run on a benchmark. These gains are highly sensitive to random seeds, data ordering, and implementation details, yet are rarely accompanied by…

Machine Learning · Computer Science 2025-11-26 Wenzhang Du

Robust content moderation classifiers are essential for the safety of Generative AI systems. In this task, differences between safe and unsafe inputs are often extremely subtle, making it difficult for classifiers (and indeed, even humans)…

Retrieval-Augmented Code Generation (RACG) is a critical technique for enhancing code generation by retrieving relevant information. In this work, we conduct an in-depth analysis of code retrieval by systematically masking specific features…

Computation and Language · Computer Science 2025-06-27 Dhruv Gupta , Gayathri Ganesh Lakshmy , Yiqing Xie

In a well-calibrated risk prediction model, the average predicted probability is close to the true event rate for any given subgroup. Such models are reliable across heterogeneous populations and satisfy strong notions of algorithmic…

Machine Learning · Computer Science 2023-07-31 Jean Feng , Alexej Gossmann , Romain Pirracchio , Nicholas Petrick , Gene Pennello , Berkman Sahiner

The interpretation of chest radiographs is an essential task for the detection of thoracic diseases and abnormalities. However, it is a challenging problem with high inter-rater variability and inherent ambiguity due to inconclusive…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Florin C. Ghesu , Bogdan Georgescu , Eli Gibson , Sebastian Guendel , Mannudeep K. Kalra , Ramandeep Singh , Subba R. Digumarthy , Sasa Grbic , Dorin Comaniciu

Professional domain knowledge underpins human civilization, serving as both the basis for industry entry and the core of complex decision-making and problem-solving. However, existing large language models often suffer from opaque inference…

Computation and Language · Computer Science 2026-04-30 Xudong Wang , Zilong Wang , Zhaoyan Ming

Retrieval-augmented generation (RAG) is increasingly deployed in enterprise search and document-centric assistants, where responses must be grounded in long and complex source materials. In practice, verifying that generated answers…

Computation and Language · Computer Science 2026-03-26 Xunzhuo Liu , Bowei He , Xue Liu , Haichen Zhang , Huamin Chen

Reliable abstention is critical for retrieval-augmented generation (RAG) systems, particularly in safety-critical domains such as women's health, where incorrect answers can lead to harm. We present an energy-based model (EBM) that learns a…

Computation and Language · Computer Science 2025-09-09 Ravi Shankar , Sheng Wong , Lin Li , Magdalena Bachmann , Alex Silverthorne , Beth Albert , Gabriel Davis Jones

Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) with external knowledge but are vulnerable to corpus poisoning and contamination attacks, which can compromise output integrity. Existing defenses often apply…

Computation and Language · Computer Science 2025-10-16 Xiaonan Si , Meilin Zhu , Simeng Qin , Lijia Yu , Lijun Zhang , Shuaitong Liu , Xinfeng Li , Ranjie Duan , Yang Liu , Xiaojun Jia

Retrieval-Augmented Generation (RAG) enhances recency and factuality in answers. However, existing evaluations rarely test how well these systems cope with real-world noise, conflicting between internal and external retrieved contexts, or…

Computation and Language · Computer Science 2025-10-29 Yixiao Zeng , Tianyu Cao , Danqing Wang , Xinran Zhao , Zimeng Qiu , Morteza Ziyadi , Tongshuang Wu , Lei Li

Safety is the major consideration in controlling complex dynamical systems using reinforcement learning (RL), where the safety certificate can provide provable safety guarantee. A valid safety certificate is an energy function indicating…

Machine Learning · Computer Science 2022-05-27 Haitong Ma , Changliu Liu , Shengbo Eben Li , Sifa Zheng , Jianyu Chen

Retrieval-Augmented Large Language Models (LLMs), which integrate external knowledge, have shown remarkable performance in medical domains, including clinical diagnosis. However, existing RAG methods often struggle to tailor retrieval…

Computation and Language · Computer Science 2025-10-16 Jiawei He , Mingyi Jia , Zhihao Jia , Junwen Duan , Yan Song , Jianxin Wang