English
Related papers

Related papers: Automated Model Evaluation for Object Detection vi…

200 papers

Environmental perception obtained via object detectors have no predictable safety layer encoded into their model schema, which creates the question of trustworthiness about the system's prediction. As can be seen from recent adversarial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Abhishek Vivekanandan , Niels Maier , J. Marius Zoellner

Evaluating object detection models in deployment is challenging because ground-truth annotations are rarely available. We introduce the Cumulative Consensus Score (CCS), a label-free monitoring signal for continuous evaluation and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Avinaash Manoharan , Xiangyu Yin , Domenik Helm , Chih-Hong Cheng

In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Trung Dang , Simon Kornblith , Huy Thong Nguyen , Peter Chin , Maryam Khademi

Performance monitoring of object detection is crucial for safety-critical applications such as autonomous vehicles that operate under varying and complex environmental conditions. Currently, object detectors are evaluated using summary…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Quazi Marufur Rahman , Niko Sünderhauf , Feras Dayoub

We introduce a new challenge for computer and robotic vision, the first ACRV Robotic Vision Challenge, Probabilistic Object Detection. Probabilistic object detection is a new variation on traditional object detection tasks, requiring…

Robotics · Computer Science 2019-04-09 John Skinner , David Hall , Haoyang Zhang , Feras Dayoub , Niko Sünderhauf

Prior work in 3D object detection evaluates models using offline metrics like average precision since closed-loop online evaluation on the downstream driving task is costly. However, it is unclear how indicative offline results are of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Tim Schreier , Katrin Renz , Andreas Geiger , Kashyap Chitta

Selecting artificial intelligence (AI) models, such as large language models (LLMs), from multiple candidates requires accurate performance estimation. This is ideally achieved through empirical evaluations involving abundant real-world…

Machine Learning · Statistics 2025-12-03 Sangwoo Park , Matteo Zecchin , Osvaldo Simeone

DETR and its variants have emerged as promising architectures for object detection, offering an end-to-end prediction pipeline. In practice, however, DETRs generate hundreds of predictions that far outnumber the actual objects present in an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Young-Jin Park , Carson Sobolewski , Navid Azizan

Model ensembles are becoming one of the most effective approaches for improving object detection performance already optimized for a single detector. Conventional methods directly fuse bounding boxes but typically fail to consider proposal…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mingyuan Mao , Baochang Zhang , David Doermann , Jie Guo , Shumin Han , Yuan Feng , Xiaodi Wang , Errui Ding

Object detection in autonomous cars is commonly based on camera images and Lidar inputs, which are often used to train prediction models such as deep artificial neural networks for decision making for object recognition, adjusting speed,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ferhat Ozgur Catak , Tao Yue , Shaukat Ali

We present an efficient 3D object detection framework based on a single RGB image in the scenario of autonomous driving. Our efforts are put on extracting the underlying 3D information in a 2D image and determining the accurate 3D bounding…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Buyu Li , Wanli Ouyang , Lu Sheng , Xingyu Zeng , Xiaogang Wang

The dominant approach for surface defect detection is the use of hand-crafted feature-based methods. However, this falls short when conditions vary that affect extracted images. So, in this paper, we sought to determine how well several…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Vasco Lopes , Luís A. Alexandre

Variants of accuracy and precision are the gold-standard by which the computer vision community measures progress of perception algorithms. One reason for the ubiquity of these metrics is that they are largely task-agnostic; we in general…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Jonah Philion , Amlan Kar , Sanja Fidler

Deep learning object detectors often return false positives with very high confidence. Although they optimize generic detection performance, such as mean average precision (mAP), they are not designed for reliability. For a reliable…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Siddharth Ancha , Junyu Nan , David Held

In the field of deep learning based computer vision, the development of deep object detection has led to unique paradigms (e.g., two-stage or set-based) and architectures (e.g., Faster-RCNN or DETR) which enable outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Denis Huseljic , Marek Herde , Mehmet Muejde , Bernhard Sick

Connecting multiple machine learning models into a pipeline is effective for handling complex problems. By breaking down the problem into steps, each tackled by a specific component model of the pipeline, the overall solution can be made…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Tomoe Kishimoto , Masahiko Saito , Junichi Tanaka , Yutaro Iiyama , Ryu Sawada , Koji Terashi

Object detection on Lidar point cloud data is a promising technology for autonomous driving and robotics which has seen a significant rise in performance and accuracy during recent years. Particularly uncertainty estimation is a crucial…

Accurately detecting and tracking multi-objects is important for safety-critical applications such as autonomous navigation. However, it remains challenging to provide guarantees on the performance of state-of-the-art techniques based on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Shuo Li , Sangdon Park , Xiayan Ji , Insup Lee , Osbert Bastani

In the field of state-of-the-art object detection, the task of object localization is typically accomplished through a dedicated subnet that emphasizes bounding box regression. This subnet traditionally predicts the object's position by…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Peng Zhi , Haoran Zhou , Hang Huang , Rui Zhao , Rui Zhou , Qingguo Zhou

A reasonable evaluation standard underlies construction of effective deep learning models. However, we find in experiments that the automatic crack detectors based on deep learning are obviously underestimated by the widely used mean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Hongyu Li , Jihe Wang , Yu Zhang , Zirui Wang , Tiejun Wang