English
Related papers

Related papers: Segment Any Events with Language

200 papers

We propose an approach for Open-World Instance Segmentation (OWIS), a task that aims to segment arbitrary unknown objects in images by generalizing from a limited set of annotated object classes during training. Our Segment Object System…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Christian Wilms , Tim Rolff , Maris Hillemann , Robert Johanson , Simone Frintrop

Retrieving accurate semantic information in challenging high dynamic range (HDR) and high-speed conditions remains an open challenge for image-based algorithms due to severe image degradations. Event cameras promise to address these…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Zhaoning Sun , Nico Messikommer , Daniel Gehrig , Davide Scaramuzza

Open world image segmentation aims to achieve precise segmentation and semantic understanding of targets within images by addressing the infinitely open set of object categories encountered in the real world. However, traditional closed-set…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Danyang Li , Tianhao Wu , Bin Li , Zhenyuan Chen , Yang Zhang , Yuxuan Li , Ming-Ming Cheng , Xiang Li

Open-vocabulary panoptic segmentation aims to segment and classify everything in diverse scenes across an unbounded vocabulary. Existing methods typically employ two-stage or single-stage framework. The two-stage framework involves cropping…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hongwei Niu , Jie Hu , Jianghang Lin , Guannan Jiang , Shengchuan Zhang

With the rapid advancement of autonomous driving, vehicle perception, particularly detection and segmentation, has placed increasingly higher demands on algorithmic performance. Pre-trained large segmentation models, especially Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xiao Wang , Ziwen Wang , Wentao Wu , Anjie Wang , Jiashu Wu , Yantao Pan , Chenglong Li

The global rise in the number of people with physical disabilities, in part due to improvements in post-trauma survivorship and longevity, has amplified the demand for advanced assistive technologies to improve mobility and independence.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yifan Xu , Vineet Kamat , Carol Menassa

Recent image segmentation models have advanced to segment images into high-quality masks for visual entities, and yet they cannot provide comprehensive semantic understanding for complex queries based on both language and vision. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shengcao Cao , Zijun Wei , Jason Kuen , Kangning Liu , Lingzhi Zhang , Jiuxiang Gu , HyunJoon Jung , Liang-Yan Gui , Yu-Xiong Wang

We address the problem of instance-level semantic segmentation, which aims at jointly detecting, segmenting and classifying every individual object in an image. In this context, existing methods typically propose candidate objects, usually…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Zeeshan Hayder , Xuming He , Mathieu Salzmann

Open-vocabulary image semantic segmentation (OVS) seeks to segment images into semantic regions across an open set of categories. Existing OVS methods commonly depend on foundational vision-language models and utilize similarity computation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qinglong Cao , Yuntian Chen , Chao Ma , Xiaokang Yang

Remote sensing image plays an irreplaceable role in fields such as agriculture, water resources, military, and disaster relief. Pixel-level interpretation is a critical aspect of remote sensing image applications; however, a prevalent…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kaiyu Li , Ruixun Liu , Xiangyong Cao , Xueru Bai , Feng Zhou , Deyu Meng , Zhi Wang

Image segmentation beyond predefined categories is a key challenge in remote sensing, where novel and unseen classes often emerge during inference. Open-vocabulary image Segmentation addresses these generalization issues in traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Saikat Dutta , Akhil Vasim , Siddhant Gole , Hamid Rezatofighi , Biplab Banerjee

Open-Vocabulary Segmentation (OVS) has drawn increasing attention for its capacity to generalize segmentation beyond predefined categories. However, existing methods typically predict segmentation masks with simple forward inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Zongyan Han , Jiale Cao , Shuo Chen , Tong Wang , Jorma Laaksonen , Rao Muhammad Anwer

Most existing methods for training-free open-vocabulary semantic segmentation are based on CLIP. While these approaches have made progress, they often face challenges in precise localization or require complex pipelines to combine separate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Kaiyu Li , Shengqi Zhang , Yujie Wang , Yupeng Deng , Zhi Wang , Deyu Meng , Xiangyong Cao

Incompletely-Supervised Concealed Object Segmentation (ISCOS) involves segmenting objects that seamlessly blend into their surrounding environments, utilizing incompletely annotated data, such as weak and semi-annotations, for model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chunming He , Kai Li , Yachao Zhang , Ziyun Yang , Youwei Pang , Longxiang Tang , Chengyu Fang , Yulun Zhang , Linghe Kong , Xiu Li , Sina Farsiu

Semantic segmentation is a crucial task in computer vision that involves segmenting images into semantically meaningful regions at the pixel level. However, existing approaches often rely on expensive human annotations as supervision for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Jun Chen , Deyao Zhu , Guocheng Qian , Bernard Ghanem , Zhicheng Yan , Chenchen Zhu , Fanyi Xiao , Mohamed Elhoseiny , Sean Chang Culatana

Segmenting and recognizing diverse object parts is a crucial ability in applications spanning various computer vision and robotic tasks. While significant progress has been made in object-level Open-Vocabulary Semantic Segmentation (OVSS),…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Meng Wei , Xiaoyu Yue , Wenwei Zhang , Shu Kong , Xihui Liu , Jiangmiao Pang

Recently, open-vocabulary image classification by vision language pre-training has demonstrated incredible achievements, that the model can classify arbitrary categories without seeing additional annotated images of that category. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Mengde Xu , Zheng Zhang , Fangyun Wei , Yutong Lin , Yue Cao , Han Hu , Xiang Bai

Recent advancements in vision foundation models (VFMs) have opened up new possibilities for versatile and efficient visual perception. In this work, we introduce Seal, a novel framework that harnesses VFMs for segmenting diverse automotive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Youquan Liu , Lingdong Kong , Jun Cen , Runnan Chen , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu

Event cameras, or Dynamic Vision Sensor (DVS), are very promising sensors which have shown several advantages over frame based cameras. However, most recent work on real applications of these cameras is focused on 3D reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-10 Iñigo Alonso , Ana C. Murillo

Advancements in 3D instance segmentation have traditionally been tethered to the availability of annotated datasets, limiting their application to a narrow spectrum of object categories. Recent efforts have sought to harness vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yingda Yin , Yuzheng Liu , Yang Xiao , Daniel Cohen-Or , Jingwei Huang , Baoquan Chen