English
Related papers

Related papers: On Calibration of Object Detectors: Pitfalls, Eval…

200 papers

We propose a Dynamic Scale Training paradigm (abbreviated as DST) to mitigate scale variation challenge in object detection. Previous strategies like image pyramid, multi-scale training, and their variants are aiming at preparing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Yukang Chen , Peizhen Zhang , Zeming Li , Yanwei Li , Xiangyu Zhang , Lu Qi , Jian Sun , Jiaya Jia

We initiate the study of the truthfulness of calibration measures in sequential prediction. A calibration measure is said to be truthful if the forecaster (approximately) minimizes the expected penalty by predicting the conditional…

Machine Learning · Computer Science 2024-11-22 Nika Haghtalab , Mingda Qiao , Kunhe Yang , Eric Zhao

Applications such as weather forecasting and personalized medicine demand models that output calibrated probability estimates---those representative of the true likelihood of a prediction. Most models are not calibrated out of the box but…

Machine Learning · Computer Science 2020-02-03 Ananya Kumar , Percy Liang , Tengyu Ma

Accurate multi-sensor calibration is essential for deploying robust perception systems in applications such as autonomous driving and intelligent transportation. Existing LiDAR-camera calibration methods often rely on manually placed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lei Cheng , Lihao Guo , Tianya Zhang , Tam Bang , Austin Harris , Mustafa Hajij , Mina Sartipi , Siyang Cao

As a core problem in computer vision, the performance of object detection has improved drastically in the past few years. Despite their impressive performance, object detectors suffer from a lack of interpretability. Visualization…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ang Cao , Justin Johnson

The highest accuracy object detectors to date are based on a two-stage approach popularized by R-CNN, where a classifier is applied to a sparse set of candidate object locations. In contrast, one-stage detectors that are applied over a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Tsung-Yi Lin , Priya Goyal , Ross Girshick , Kaiming He , Piotr Dollár

Confidence calibration - the process to calibrate the output probability distribution of neural networks - is essential for safety-critical applications of such networks. Recent works verify the link between mis-calibration and overfitting.…

Machine Learning · Computer Science 2023-05-24 Linwei Tao , Minjing Dong , Daochang Liu , Changming Sun , Chang Xu

Sensor setups of robotic platforms commonly include both camera and LiDAR as they provide complementary information. However, fusing these two modalities typically requires a highly accurate calibration between them. In this paper, we…

Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception of the environment…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Shoaib Azam , Farzeen Munir , Moongu Jeon

Given multiple datasets with different label spaces, the goal of this work is to train a single object detector predicting over the union of all the label spaces. The practical benefits of such an object detector are obvious and significant…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Xiangyun Zhao , Samuel Schulter , Gaurav Sharma , Yi-Hsuan Tsai , Manmohan Chandraker , Ying Wu

When an object detector is deployed in a novel setting it often experiences a drop in performance. This paper studies how an embodied agent can automatically fine-tune a pre-existing object detector while exploring and acquiring images in a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Gianluca Scarpellini , Stefano Rosa , Pietro Morerio , Lorenzo Natale , Alessio Del Bue

In this work, we highlight and perform a comprehensive study on calibration attacks, a form of adversarial attacks that aim to trap victim models to be heavily miscalibrated without altering their predicted labels, hence endangering the…

Machine Learning · Computer Science 2024-12-03 Stephen Obadinma , Xiaodan Zhu , Hongyu Guo

The prediction accuracy of machine learning methods is steadily increasing, but the calibration of their uncertainty predictions poses a significant challenge. Numerous works focus on obtaining well-calibrated predictive models, but less is…

Machine Learning · Statistics 2023-12-07 Donghwan Lee , Xinmeng Huang , Hamed Hassani , Edgar Dobriban

The deployment of machine learning classifiers in high-stakes domains requires well-calibrated confidence scores for model predictions. In this paper we introduce the notion of variable-based calibration to characterize calibration…

Machine Learning · Computer Science 2023-04-07 Markelle Kelly , Padhraic Smyth

DETR has set up a simple end-to-end pipeline for object detection by formulating this task as a set prediction problem, showing promising potential. Despite its notable advancements, this paper identifies two key forms of misalignment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zhi Cai , Songtao Liu , Guodong Wang , Zheng Ge , Xiangyu Zhang , Di Huang

To accommodate rapid changes in the real world, the cognition system of humans is capable of continually learning concepts. On the contrary, conventional deep learning models lack this capability of preserving previously learned knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Can Peng , Kun Zhao , Sam Maksoud , Tianren Wang , Brian C. Lovell

Frequently, a set of objects has to be evaluated by a panel of assessors, but not every object is assessed by every assessor. A problem facing such panels is how to take into account different standards amongst panel members and varying…

Methodology · Statistics 2017-02-16 Robert S. MacKay , Ralph Kenna , Robert J. Low , Sarah Parker

Variants of accuracy and precision are the gold-standard by which the computer vision community measures progress of perception algorithms. One reason for the ubiquity of these metrics is that they are largely task-agnostic; we in general…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Jonah Philion , Amlan Kar , Sanja Fidler

Model calibration and debiasing are fundamental yet operationally expensive challenges in large-scale recommendation systems. Existing approaches treat them as separate problems requiring distinct infrastructure: post-hoc calibration…

Information Retrieval · Computer Science 2026-04-28 Hailing Cheng , Yafang Yang , Hemeng Tao , Fengyu Zhang

Recent years have witnessed the success of introducing deep learning models to time series forecasting. From a data generation perspective, we illustrate that existing models are susceptible to distribution shifts driven by temporal…

Machine Learning · Computer Science 2024-06-12 Mouxiang Chen , Lefei Shen , Han Fu , Zhuo Li , Jianling Sun , Chenghao Liu