English
Related papers

Related papers: Beyond mAP: Towards better evaluation of instance …

200 papers

Segmentation is a fundamental vision task underlying numerous downstream applications. Recent promptable segmentation models, such as Segment Anything Model 3 (SAM3), extend segmentation from category-agnostic mask prediction to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Shuang Liang , Zeqing Wang , Yuxian Li , Xihui Liu , Han Wang

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

Semantic segmentation consists of predicting a semantic label for each image pixel. While existing deep learning approaches achieve high accuracy, they often overlook the ordinal relationships between classes, which can provide critical…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ricardo P. M. Cruz , Rafael Cristino , Jaime S. Cardoso

We propose a new method for semantic instance segmentation, by first computing how likely two pixels are to belong to the same object, and then by grouping similar pixels together. Our similarity metric is based on a deep, fully…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Alireza Fathi , Zbigniew Wojna , Vivek Rathod , Peng Wang , Hyun Oh Song , Sergio Guadarrama , Kevin P. Murphy

Segmenting object instances is a key task in machine perception, with safety-critical applications in robotics and autonomous driving. We introduce a novel approach to instance segmentation that jointly leverages measurements from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Alex Zihao Zhu , Vincent Casser , Reza Mahjourian , Henrik Kretzschmar , Sören Pirk

Semantic segmentation has been a major topic in research and industry in recent years. However, due to the computation complexity of pixel-wise prediction and backpropagation algorithm, semantic segmentation has been demanding in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Jiayi Yang , Lei Deng , Yukuan Yang , Yuan Xie , Guoqi Li

We address the problem of instance-level semantic segmentation, which aims at jointly detecting, segmenting and classifying every individual object in an image. In this context, existing methods typically propose candidate objects, usually…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Zeeshan Hayder , Xuming He , Mathieu Salzmann

Instance segmentation is the problem of detecting and delineating each distinct object of interest appearing in an image. Current instance segmentation approaches consist of ensembles of modules that are trained independently of each other,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-26 Bernardino Romera-Paredes , Philip H. S. Torr

Large scale object detection with thousands of classes introduces the problem of many contradicting false positive detections, which have to be suppressed. Class-independent non-maximum suppression has traditionally been used for this step,…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Damian Mrowca , Marcus Rohrbach , Judy Hoffman , Ronghang Hu , Kate Saenko , Trevor Darrell

Metrics optimized in complex machine learning tasks are often selected in an ad-hoc manner. It is unknown how they align with human expert perception. We explore the correlations between established quantitative segmentation quality metrics…

We aim to detect all instances of a category in an image and, for each instance, mark the pixels that belong to it. We call this task Simultaneous Detection and Segmentation (SDS). Unlike classical bounding box detection, SDS requires a…

Computer Vision and Pattern Recognition · Computer Science 2014-07-08 Bharath Hariharan , Pablo Arbeláez , Ross Girshick , Jitendra Malik

We present an approach for jointly matching and segmenting object instances of the same category within a collection of images. In contrast to existing algorithms that tackle the tasks of semantic matching and object co-segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Yun-Chun Chen , Yen-Yu Lin , Ming-Hsuan Yang , Jia-Bin Huang

The ability to detect failures and anomalies are fundamental requirements for building reliable systems for computer vision applications, especially safety-critical applications of semantic segmentation, such as autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Yingda Xia , Yi Zhang , Fengze Liu , Wei Shen , Alan Yuille

Instance segmentation is an important problem in computer vision, with applications in autonomous driving, drone navigation and robotic manipulation. However, most existing methods are not real-time, complicating their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Laurynas Miksys , Saumya Jetley , Michael Sapienza , Stuart Golodetz , Philip H. S. Torr

Recently, proposal-free instance segmentation has received increasing attention due to its concise and efficient pipeline. Generally, proposal-free methods generate instance-agnostic semantic segmentation labels and instance-aware features…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Naiyu Gao , Yanhu Shan , Yupei Wang , Xin Zhao , Yinan Yu , Ming Yang , Kaiqi Huang

Probabilistic convolutional neural networks, which predict distributions of predictions instead of point estimates, led to recent advances in many areas of computer vision, from image reconstruction to semantic segmentation. Besides state…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Josef Lorenz Rumberger , Lisa Mais , Dagmar Kainmueller

We propose an approach to instance-level image segmentation that is built on top of category-level segmentation. Specifically, for each pixel in a semantic category mask, its corresponding instance bounding box is predicted using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Zifeng Wu , Chunhua Shen , Anton van den Hengel

In image segmentation, there is often more than one plausible solution for a given input. In medical imaging, for example, experts will often disagree about the exact location of object boundaries. Estimating this inherent uncertainty and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Miguel Monteiro , Loïc Le Folgoc , Daniel Coelho de Castro , Nick Pawlowski , Bernardo Marques , Konstantinos Kamnitsas , Mark van der Wilk , Ben Glocker

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng

Single-point annotation is increasingly prominent in visual tasks for labeling cost reduction. However, it challenges tasks requiring high precision, such as the point-prompted instance segmentation (PPIS) task, which aims to estimate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Zhaoyang Wei , Xumeng Han , Xuehui Yu , Xue Yang , Guorong Li , Zhenjun Han , Jianbin Jiao