English
Related papers

Related papers: SIS-Challenge: Event-based Spatio-temporal Instanc…

200 papers

Despite the progress of image segmentation for accurate visual entity segmentation, completing the diverse requirements of image editing applications for different-level region-of-interest selections remains unsolved. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lu Qi , Jason Kuen , Weidong Guo , Jiuxiang Gu , Zhe Lin , Bo Du , Yu Xu , Ming-Hsuan Yang

Surgical instrument segmentation (SIS) on endoscopic images stands as a long-standing and essential task in the context of computer-assisted interventions for boosting minimally invasive surgery. Given the recent surge of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Mingyu Sheng , Jianan Fan , Dongnan Liu , Ron Kikinis , Weidong Cai

We propose an approach to instance-level image segmentation that is built on top of category-level segmentation. Specifically, for each pixel in a semantic category mask, its corresponding instance bounding box is predicted using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Zifeng Wu , Chunhua Shen , Anton van den Hengel

Video Object Segmentation (VOS) is one of the most fundamental and challenging tasks in computer vision and has a wide range of applications. Most existing methods rely on spatiotemporal memory networks to extract frame-level features and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengjiao Wang , Junpei Zhang , Xu Liu , Yuting Yang , Mengru Ma

Tracking and segmenting multiple similar objects with distinct or complex parts in long-term videos is particularly challenging due to the ambiguity in identifying target components and the confusion caused by occlusion, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xin Li , Deshui Miao , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang

Recently, video object segmentation (VOS) networks typically use memory-based methods: for each query frame, the mask is predicted by space-time matching to memory frames. Despite these methods having superior performance, they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yadang Chen , Wentao Zhu , Zhi-Xin Yang , Enhua Wu

Event cameras excel in capturing high-contrast scenes and dynamic objects, offering a significant advantage over traditional frame-based cameras. Despite active research into leveraging event cameras for semantic segmentation, generating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Hoonhee Cho , Sung-Hoon Yoon , Hyeokjun Kweon , Kuk-Jin Yoon

Pixel-level Video Understanding requires effectively integrating three-dimensional data in both spatial and temporal dimensions to learn accurate and stable semantic information from continuous frames. However, existing advanced models on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Chen Liang , Qiang Guo , Chongkai Yu , Chengjing Wu , Ting Liu , Luoqi Liu

Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Since the real-world is actually video-based rather than…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Biao Wu , Shaoli Liu , Diankai Zhang , Chengjian Zheng , Si Gao , Xiaofeng Zhang , Ning Wang

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

Semantic segmentation is one of the basic, yet essential scene understanding tasks for an autonomous agent. The recent developments in supervised machine learning and neural networks have enjoyed great success in enhancing the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 S. Ehsan Mirsadeghi , Ali Royat , Hamid Rezatofighi

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

We present the 2018 DAVIS Challenge on Video Object Segmentation, a public competition specifically designed for the task of video object segmentation. It builds upon the DAVIS 2017 dataset, which was presented in the previous edition of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sergi Caelles , Alberto Montes , Kevis-Kokitsi Maninis , Yuhua Chen , Luc Van Gool , Federico Perazzi , Jordi Pont-Tuset

We propose Masked-Attention Transformers for Surgical Instrument Segmentation (MATIS), a two-stage, fully transformer-based method that leverages modern pixel-wise attention mechanisms for instrument segmentation. MATIS exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Nicolás Ayobi , Alejandra Pérez-Rondón , Santiago Rodríguez , Pablo Arbeláez

In this work we predict vehicle speed and steering angle given camera image frames. Our key contribution is using an external pre-trained neural network for segmentation. We augment the raw images with their segmentation masks and mirror…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Antonia Lovjer , Minsu Yeom , Benedikt D. Schifferer , Iddo Drori

The semantic segmentation (SS) task aims to create a dense classification by labeling at the pixel level each object present on images. Convolutional neural network (CNN) approaches have been widely used, and exhibited the best results in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Darwin Saire , Adín Ramírez Rivera

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Semi-supervised Video Object Segmentation aims to segment a specified target throughout a video sequence, initialized by a first-frame mask. Previous methods rely heavily on appearance-based pattern matching and thus exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhixiong Zhang , Shuangrui Ding , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jiaqi Wang

Satellite Image Time Series (SITS) representation learning is complex due to high spatiotemporal resolutions, irregular acquisition times, and intricate spatiotemporal interactions. These challenges result in specialized neural network…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Xin Cai , Yaxin Bi , Peter Nicholl , Roy Sterritt

State-of-the-art transformer-based video instance segmentation (VIS) approaches typically utilize either single-scale spatio-temporal features or per-frame multi-scale features during the attention computations. We argue that such an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Omkar Thawakar , Sanath Narayan , Jiale Cao , Hisham Cholakkal , Rao Muhammad Anwer , Muhammad Haris Khan , Salman Khan , Michael Felsberg , Fahad Shahbaz Khan