English
Related papers

Related papers: InterFormer: Real-time Interactive Image Segmentat…

200 papers

Recent transformer-based offline video instance segmentation (VIS) approaches achieve encouraging results and significantly outperform online approaches. However, their reliance on the whole video and the immense computational complexity…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Rajat Koner , Tanveer Hannan , Suprosanna Shit , Sahand Sharifzadeh , Matthias Schubert , Thomas Seidl , Volker Tresp

Many deep learning based automated medical image segmentation systems, in reality, face difficulties in deployment due to the cost of massive data annotation and high latency in model iteration. We propose a dynamic interactive learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mu Tian , Xiaohui Chen , Yi Gao

Pixelwise annotation of image sequences can be very tedious for humans. Interactive video object segmentation aims to utilize automatic methods to speed up the process and reduce the workload of the annotators. Most contemporary approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Viktor Varga , András Lőrincz

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Interactive segmentation allows efficient label generation by leveraging user-provided clicks to progressively refine predictions, which is critical when fully supervised labels are costly or generalization to unseen classes is needed.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xueyang Kang , Zijian Yu , Kourosh Khoshelham , Liangliang Nan

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

The ascension of Unmanned Aerial Vehicles (UAVs) in various fields necessitates effective UAV image segmentation, which faces challenges due to the dynamic perspectives of UAV-captured images. Traditional segmentation algorithms falter as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Deyi Ji , Wenwei Jin , Hongtao Lu , Feng Zhao

In the interactive segmentation, users initially click on the target object to segment the main body and then provide corrections on mislabeled regions to iteratively refine the segmentation masks. Most existing methods transform these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Chun-Tse Lin , Wei-Chih Tu , Chih-Ting Liu , Shao-Yi Chien

Interactive segmentation is to segment the mask of the target object according to the user's interactive prompts. There are two mainstream strategies: early fusion and late fusion. Current specialist models utilize the early fusion strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Chongkai Yu , Ting Liu , Anqi Li , Xiaochao Qu , Chengjing Wu , Luoqi Liu , Xiaolin Hu

Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation that it is…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Ziniu Qian , Kailu Li , Maode Lai , Eric I-Chao Chang , Bingzheng Wei , Yubo Fan , Yan Xu

Interactive segmentation uses real-time user inputs, such as mouse clicks, to iteratively refine model predictions. Although not originally designed to address distribution shifts, this paradigm naturally lends itself to such challenges. In…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Wentian Xu , Ziyun Liang , Harry Anthony , Yasin Ibrahim , Felix Cohen , Guang Yang , Konstantinos Kamnitsas

High-quality training data play a key role in image segmentation tasks. Usually, pixel-level annotations are expensive, laborious and time-consuming for the large volume of training data. To reduce labelling cost and improve segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yuying Hao , Yi Liu , Zewu Wu , Lin Han , Yizhou Chen , Guowei Chen , Lutao Chu , Shiyu Tang , Zhiliang Yu , Zeyu Chen , Baohua Lai

Point-based interactive image segmentation can ease the burden of mask annotation in applications such as semantic segmentation and image editing. However, fully extracting the target mask with limited user inputs remains challenging. We…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Chaowei Fang , Ziyin Zhou , Junye Chen , Hanjing Su , Qingyao Wu , Guanbin Li

The goal of click-based interactive image segmentation is to obtain precise object segmentation masks with limited user interaction, i.e., by a minimal number of user clicks. Existing methods require users to provide all the clicks: by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qin Liu , Meng Zheng , Benjamin Planche , Srikrishna Karanam , Terrence Chen , Marc Niethammer , Ziyan Wu

Segmenting objects of interest in an image is an essential building block of applications such as photo-editing and image analysis. Under interactive settings, one should achieve good segmentations while minimizing user input. Current deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Soumajit Majumder , Ansh Khurana , Abhinav Rai , Angela Yao

Image segmentation plays a crucial role in extracting important objects of interest from images, enabling various applications. While existing methods have shown success in segmenting clean images, they often struggle to produce accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Han Zhang , Daoping Zhang , Lok Ming Lui

In this paper, we introduce \texttt{IAFormer}, a novel Transformer-based architecture that efficiently integrates pairwise particle interactions through a dynamic sparse attention mechanism. \texttt{IAFormer} has two new mechanisms within…

High Energy Physics - Phenomenology · Physics 2026-04-21 W. Esmail , A. Hammad , M. Nojiri

Interactive segmentation is a crucial research area in medical image analysis aiming to boost the efficiency of costly annotations by incorporating human feedback. This feedback takes the form of clicks, scribbles, or masks and allows for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Zdravko Marinov , Paul F. Jäger , Jan Egger , Jens Kleesiek , Rainer Stiefelhagen

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Interactive segmentation enables users to extract binary masks of target objects through simple interactions such as clicks, scribbles, and boxes. However, existing methods often support only limited interaction forms and struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Xi Chen , Hengshuang Zhao