English
Related papers

Related papers: Improving estimation of the volume under the ROC s…

200 papers

Perceptually-inspired objective functions such as the perceptual evaluation of speech quality (PESQ), signal-to-distortion ratio (SDR), and short-time objective intelligibility (STOI), have recently been used to optimize performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-27 Khandokar Md. Nayem , Donald S. Williamson

Breast ultrasound (BUS) segmentation provides lesion boundaries essential for computer-aided diagnosis and treatment planning. While promptable methods can improve segmentation performance and tumor delineation when text or spatial prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Raja Mallina , Bryar Shareef

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

Instrumental variable (IV) methods allow us the opportunity to address unmeasured confounding in causal inference. However, most IV methods are only applicable to discrete or continuous outcomes with very few IV methods for censored…

Methodology · Statistics 2020-09-30 Youjin Lee , Edward H. Kennedy , Nandita Mitra

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

Image and Video Processing · Electrical Eng. & Systems 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

In a subjective experiment to evaluate the perceptual audiovisual quality of multimedia and television services, raw opinion scores collected from test subjects are often noisy and unreliable. To produce the final mean opinion scores (MOS),…

Multimedia · Computer Science 2021-05-10 Zhi Li , Christos G. Bampis , Lukáš Krasula , Lucjan Janowski , Ioannis Katsavounidis

Mean Opinion Score (MOS) is a popular measure for evaluating synthesized speech. However, the scores obtained in MOS tests are heavily dependent upon many contextual factors. One such factor is the overall range of quality of the samples…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Erica Cooper , Junichi Yamagishi

Results from multiple diagnostic tests are usually combined to improve the overall diagnostic accuracy. For binary classification, maximization of the empirical estimate of the area under the receiver operating characteristic (ROC) curve is…

Methodology · Statistics 2026-04-16 Raju Maiti , Jialiang Li , Priyam Das , Lei Feng , Derek Hausenloy , Bibhas Chakraborty

We consider the estimation problem in a regression setting where the outcome variable is subject to nonignorable missingness and identifiability is ensured by the shadow variable approach. We propose a versatile estimation procedure where…

Methodology · Statistics 2019-07-09 Jiwei Zhao , Yanyuan Ma

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are useful for evaluating binary classification models, but difficult to use for learning since the Area Under the Curve (AUC)…

Machine Learning · Statistics 2021-07-06 Jonathan Hillman , Toby Dylan Hocking

Mean Opinion Score (MOS) prediction has made significant progress in specific domains. However, the unstable performance of MOS prediction models across diverse samples presents ongoing challenges in the practical application of these…

Machine Learning · Computer Science 2024-08-26 Hui Wang , Shiwan Zhao , Jiaming Zhou , Xiguang Zheng , Haoqin Sun , Xuechen Wang , Yong Qin

The area under the curve (AUC) of the mean cumulative function (MCF) has recently been introduced as a novel estimand for evaluating treatment effects in recurrent event settings, offering an alternative to the commonly used…

Methodology · Statistics 2025-07-22 Jiren Sun , Tuo Wang , Yanyao Yi , Ting Ye , Jun Shao , Yu Du

Medical studies that depend on electronic health records (EHR) data are often subject to measurement error, as the data are not collected to support research questions under study. These data errors, if not accounted for in study analyses,…

Methodology · Statistics 2020-03-10 Eric J. Oh , Bryan E. Shepherd , Thomas Lumley , Pamela A. Shaw

In recent years, data selection has emerged as a core issue for large-scale visual-language model pretraining, especially on noisy web-curated datasets. One widely adopted strategy assigns quality scores such as CLIP similarity for each…

Machine Learning · Computer Science 2024-02-06 Yiping Wang , Yifang Chen , Wendan Yan , Kevin Jamieson , Simon Shaolei Du

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

Applications · Statistics 2025-08-12 Agus Sudjianto , Alice J. Liu

External validation remains rare in healthcare machine learning despite being critical for establishing real-world feasibility. We developed an ensemble framework to predict blood pressure from electronic health records, incorporating…

Machine Learning · Computer Science 2026-03-20 Md Basit Azam , Sarangthem Ibotombi Singh

Instrumental variables (IVs) are often continuous, arising in diverse fields such as economics, epidemiology, and the social sciences. Existing approaches for continuous IVs typically impose strong parametric models or assume homogeneous…

Methodology · Statistics 2025-10-17 Mei Dong , Lin Liu , Dingke Tang , Geoffrey Liu , Wei Xu , Linbo Wang

The determination of the sample size required by a crossover trial typically depends on the specification of one or more variance components. Uncertainty about the value of these parameters at the design stage means that there is often a…

Methodology · Statistics 2018-03-28 Michael Grayling , Adrian Mander , James Wason

The System Usability Scale (SUS) is a short, survey-based approach used to determine the usability of a system from an end user perspective once a prototype is available for assessment. Individual scores are gathered using a 10-question…

Methodology · Statistics 2021-01-26 Nicholas Clark , Matthew Dabkowski , Patrick Driscoll , Dereck Kennedy , Ian Kloo , Heidy Shi