English
Related papers

Related papers: Calibrating Probabilistic Object Detectors with An…

200 papers

Reliable uncertainty estimation for 3D object detection is critical for deploying safe autonomous systems, yet modern detectors remain poorly calibrated, especially under distribution shifts. Although post-hoc calibration methods address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Till Beemelmanns , Alexey Nekrasov , Stefan Vilceanu , Jonas Steinhaus , Timo Woopen , Bastian Leibe , Lutz Eckstein

In this paper, we introduce a new technique that combines two popular methods to estimate uncertainty in object detection. Quantifying uncertainty is critical in real-world robotic applications. Traditional detection models can be ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Subjective NLP tasks usually rely on human annotations provided by multiple annotators, whose judgments may vary due to their diverse backgrounds and life experiences. Traditional methods often aggregate multiple annotations into a single…

Computation and Language · Computer Science 2025-10-17 Benedetta Muscato , Praveen Bushipaka , Gizem Gezici , Lucia Passaro , Fosca Giannotti

Methodologies for incorporating the uncertainties characteristic of data-driven object detectors into object tracking algorithms are explored. Object tracking methods rely on measurement error models, typically in the form of measurement…

Systems and Control · Electrical Eng. & Systems 2021-11-04 Anish Muthali , Forrest Laine , Claire Tomlin

Confidence calibration assumes a unique ground-truth label per input, yet this assumption fails wherever annotators genuinely disagree. Post-hoc calibrators fitted on majority-voted labels, the standard single-label targets used in…

Machine Learning · Computer Science 2026-03-25 Linwei Tao , Haoyang Luo , Minjing Dong , Chang Xu

We propose the ambiguity problem for the foreground object segmentation task and motivate the importance of estimating and accounting for this ambiguity when designing vision systems. Specifically, we distinguish between images which lead…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Danna Gurari , Kun He , Bo Xiong , Jianming Zhang , Mehrnoosh Sameki , Suyog Dutt Jain , Stan Sclaroff , Margrit Betke , Kristen Grauman

Most supervised machine learning tasks are subject to irreducible prediction errors. Probabilistic predictive models address this limitation by providing probability distributions that represent a belief over plausible targets, rather than…

Machine Learning · Statistics 2022-10-25 David Widmann , Fredrik Lindsten , Dave Zachariah

The predictive performance of supervised learning algorithms depends on the quality of labels. In a typical label collection process, multiple annotators provide subjective noisy estimates of the "truth" under the influence of their varying…

Machine Learning · Computer Science 2019-06-18 Ryutaro Tanno , Ardavan Saeedi , Swami Sankaranarayanan , Daniel C. Alexander , Nathan Silberman

Reliable uncertainty estimation is crucial for robust object detection in autonomous driving. However, previous works on probabilistic object detection either learn predictive probability for bounding box regression in an un-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Di Feng , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

Object detectors are vital to many modern computer vision applications. However, even state-of-the-art object detectors are not perfect. On two images that look similar to human eyes, the same detector can make different predictions because…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Caleb Tung , Abhinav Goel , Fischer Bordwell , Nick Eliopoulos , Xiao Hu , George K. Thiruvathukal , Yung-Hsiang Lu

Majority voting and averaging are common approaches employed to resolve annotator disagreements and derive single ground truth labels from multiple annotations. However, annotators may systematically disagree with one another, often…

Computation and Language · Computer Science 2021-10-13 Aida Mostafazadeh Davani , Mark Díaz , Vinodkumar Prabhakaran

Object detectors often experience a drop in performance when new environmental conditions are insufficiently represented in the training data. This paper studies how to automatically fine-tune a pre-existing object detector while exploring…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Gianluca Scarpellini , Stefano Rosa , Pietro Morerio , Lorenzo Natale , Alessio Del Bue

Obtaining annotations for complex computer vision tasks such as object detection is an expensive and time-intense endeavor involving a large number of human workers or expert opinions. Reducing the amount of annotations required while…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Marius Schubert , Tobias Riedlinger , Karsten Kahl , Matthias Rottmann

Large-scale well-annotated datasets are of great importance for training an effective object detector. However, obtaining accurate bounding box annotations is laborious and demanding. Unfortunately, the resultant noisy bounding boxes could…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Donghao Zhou , Jialin Li , Jinpeng Li , Jiancheng Huang , Qiang Nie , Yong Liu , Bin-Bin Gao , Qiong Wang , Pheng-Ann Heng , Guangyong Chen

Frequently, a set of objects has to be evaluated by a panel of assessors, but not every object is assessed by every assessor. A problem facing such panels is how to take into account different standards amongst panel members and varying…

Methodology · Statistics 2017-02-16 Robert S. MacKay , Ralph Kenna , Robert J. Low , Sarah Parker

This study introduces a laboratory experiment designed to assess the influence of annotation strategies, levels of imbalanced data, and prior experience, on the performance of human annotators. The experiment focuses on labeling aerial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Roni Blushtein-Livnon , Tal Svoray , Michael Dorman

DETR and its variants have emerged as promising architectures for object detection, offering an end-to-end prediction pipeline. In practice, however, DETRs generate hundreds of predictions that far outnumber the actual objects present in an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Young-Jin Park , Carson Sobolewski , Navid Azizan

Calibration is a frequently invoked concept when useful label probability estimates are required on top of classification accuracy. A calibrated model is a function whose values correctly reflect underlying label probabilities. Calibration…

Machine Learning · Computer Science 2024-12-03 Alireza Torabian , Ruth Urner

Pedestrian detection is among the most safety-critical features of driver assistance systems for autonomous vehicles. One of the most complex detection challenges is that of partial occlusion, where a target object is only partially…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Shane Gilroy , Martin Glavin , Edward Jones , Darragh Mullins

Deep neural networks are becoming increasingly powerful and large and always require more labelled data to be trained. However, since annotating data is time-consuming, it is now necessary to develop systems that show good performance while…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Mélodie Boillet , Christopher Kermorvant , Thierry Paquet