English
Related papers

Related papers: YOLACT: Real-time Instance Segmentation

200 papers

Increasing the accuracy of instance segmentation methods is often done at the expense of speed. Using coarser representations, we can reduce the number of parameters and thus obtain real-time masks. In this paper, we take inspiration from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Katia Jodogne-Del Litto , Guillaume-Alexandre Bilodeau

Video instance segmentation on mobile devices is an important yet very challenging edge AI problem. It mainly suffers from (1) heavy computation and memory costs for frame-by-frame pixel-level instance perception and (2) complicated…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Renhong Zhang , Tianheng Cheng , Shusheng Yang , Haoyi Jiang , Shuai Zhang , Jiancheng Lyu , Xin Li , Xiaowen Ying , Dashan Gao , Wenyu Liu , Xinggang Wang

Recently, query based object detection frameworks achieve comparable performance with previous state-of-the-art object detectors. However, how to fully leverage such frameworks to perform instance segmentation remains an open problem. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yuxin Fang , Shusheng Yang , Xinggang Wang , Yu Li , Chen Fang , Ying Shan , Bin Feng , Wenyu Liu

We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-25 Kaiming He , Georgia Gkioxari , Piotr Dollár , Ross Girshick

Panoptic segmentation is a complex full scene parsing task requiring simultaneous instance and semantic segmentation at high resolution. Current state-of-the-art approaches cannot run in real-time, and simplifying these architectures to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rui Hou , Jie Li , Arjun Bhargava , Allan Raventos , Vitor Guizilini , Chao Fang , Jerome Lynch , Adrien Gaidon

Current state-of-the-art instance segmentation methods are not suited for real-time applications like autonomous driving, which require fast execution times at high accuracy. Although the currently dominant proposal-based methods have high…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Davy Neven , Bert De Brabandere , Marc Proesmans , Luc Van Gool

In this paper, we introduce an anchor-box free and single shot instance segmentation method, which is conceptually simple, fully convolutional and can be used as a mask prediction module for instance segmentation, by easily embedding it…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Enze Xie , Peize Sun , Xiaoge Song , Wenhai Wang , Ding Liang , Chunhua Shen , Ping Luo

We propose a new approach for 3D instance segmentation based on sparse convolution and point affinity prediction, which indicates the likelihood of two points belonging to the same instance. The proposed network, built upon submanifold…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Chen Liu , Yasutaka Furukawa

The two-stage methods for instance segmentation, e.g. Mask R-CNN, have achieved excellent performance recently. However, the segmented masks are still very coarse due to the downsampling operations in both the feature pyramid and the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Gang Zhang , Xin Lu , Jingru Tan , Jianmin Li , Zhaoxiang Zhang , Quanquan Li , Xiaolin Hu

Previous top-performing approaches for point cloud instance segmentation involve a bottom-up strategy, which often includes inefficient operations or complex pipelines, such as grouping over-segmented components, introducing additional…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Tong He , Chunhua Shen , Anton van den Hengel

In this paper, we explore the mask representation in instance segmentation with Point-of-Interest (PoI) features. Differentiating multiple potential instances within a single PoI feature is challenging because learning a high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Lu Qi , Yi Wang , Yukang Chen , Yingcong Chen , Xiangyu Zhang , Jian Sun , Jiaya Jia

3D instance segmentation is crucial for applications demanding comprehensive 3D scene understanding. In this paper, we introduce a novel method that simultaneously learns coefficients and prototypes. Employing an overcomplete sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Remco Royen , Leon Denis , Adrian Munteanu

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

We present a high-performance method that can achieve mask-level instance segmentation with only bounding-box annotations for training. While this setting has been studied in the literature, here we show significantly stronger performance…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Zhi Tian , Chunhua Shen , Xinlong Wang , Hao Chen

This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, deep snake uses a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Sida Peng , Wen Jiang , Huaijin Pi , Xiuli Li , Hujun Bao , Xiaowei Zhou

Fully convolutional networks (FCNs) have been proven very successful for semantic segmentation, but the FCN outputs are unaware of object instances. In this paper, we develop FCNs that are capable of proposing instance-level segment…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Jifeng Dai , Kaiming He , Yi Li , Shaoqing Ren , Jian Sun

In this paper, we aim to design an efficient real-time object detector that exceeds the YOLO series and is easily extensible for many object recognition tasks such as instance segmentation and rotated object detection. To obtain a more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Chengqi Lyu , Wenwei Zhang , Haian Huang , Yue Zhou , Yudong Wang , Yanyi Liu , Shilong Zhang , Kai Chen

3D instance segmentation is crucial for obtaining an understanding of a point cloud scene. This paper presents a novel neural network architecture for performing instance segmentation on 3D point clouds. We propose to jointly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Remco Royen , Leon Denis , Adrian Munteanu

Modern 3D semantic instance segmentation approaches predominantly rely on specialized voting mechanisms followed by carefully designed geometric clustering techniques. Building on the successes of recent Transformer-based methods for object…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jonas Schult , Francis Engelmann , Alexander Hermans , Or Litany , Siyu Tang , Bastian Leibe

We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch that propagates…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gedas Bertasius , Lorenzo Torresani