English
Related papers

Related papers: Detecting Everything in the Open World: Towards Un…

200 papers

Current closed-set instance segmentation models rely on pre-defined class labels for each mask during training and evaluation, largely limiting their ability to detect novel objects. Open-world instance segmentation (OWIS) models address…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Muzhi Zhu , Hengtao Li , Hao Chen , Chengxiang Fan , Weian Mao , Chenchen Jing , Yifan Liu , Chunhua Shen

Active learning for object detection is conventionally achieved by applying techniques developed for classification in a way that aggregates individual detections into image-level selection criteria. This is typically coupled with the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Michael Laielli , Giscard Biamby , Dian Chen , Ritwik Gupta , Adam Loeffler , Phat Dat Nguyen , Ross Luo , Trevor Darrell , Sayna Ebrahimi

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

We propose the new task 'open-world video instance segmentation and captioning'. It requires to detect, segment, track and describe with rich captions never before seen objects. This challenging task can be addressed by developing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Anwesa Choudhuri , Girish Chowdhary , Alexander G. Schwing

We consider the problem of universal decoding for arbitrary unknown channels in the random coding regime. For a given random coding distribution and a given class of metric decoders, we propose a generic universal decoder whose average…

Information Theory · Computer Science 2016-11-17 Neri Merhav

Our work addresses the problem of learning to localize objects in an open-world setting, i.e., given the bounding box information of a limited number of object classes during training, the goal is to localize all objects, belonging to both…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ashish Singh , Michael J. Jones , Kuan-Chuan Peng , Anoop Cherian , Moitreya Chatterjee , Erik Learned-Miller

Detecting objects in real-world scenes is a complex task due to various challenges, including the vast range of object categories, and potential encounters with previously unknown or unseen objects. The challenges necessitate the…

The advancement of object detection (OD) in open-vocabulary and open-world scenarios is a critical challenge in computer vision. This work introduces OmDet, a novel language-aware object detection architecture, and an innovative training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Tiancheng Zhao , Peng Liu , Kyusong Lee

Open-world perception aims to develop a model adaptable to novel domains and various sensor configurations and can understand uncommon objects and corner cases. However, current research lacks sufficiently comprehensive open-world 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhongyu Xia , Jishuo Li , Zhiwei Lin , Xinhao Wang , Yongtao Wang , Ming-Hsuan Yang

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman

Datasets collected from the open world unavoidably suffer from various forms of randomness or noiseness, leading to the ubiquity of aleatoric (data) uncertainty. Quantifying such uncertainty is particularly pivotal for object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Peng Cui , Guande He , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

Running AI models on smart edge devices can unlock versatile user experiences, but presents challenges due to limited compute and the need to handle multiple tasks simultaneously. This requires a vision encoder with small size but powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Chenchen Zhu , Saksham Suri , Cijo Jose , Maxime Oquab , Marc Szafraniec , Wei Wen , Yunyang Xiong , Patrick Labatut , Piotr Bojanowski , Raghuraman Krishnamoorthi , Vikas Chandra

Interpreting camera data is key for autonomously acting systems, such as autonomous vehicles. Vision systems that operate in real-world environments must be able to understand their surroundings and need the ability to deal with novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Matteo Sodano , Federico Magistri , Lucas Nunes , Jens Behley , Cyrill Stachniss

Attributes possess appealing properties and benefit many computer vision problems, such as object recognition, learning with humans in the loop, and image retrieval. Whereas the existing work mainly pursues utilizing attributes for various…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Chuang Gan , Tianbao Yang , Boqing Gong

Object detection remains as one of the most notorious open problems in computer vision. Despite large strides in accuracy in recent years, modern object detectors have started to saturate on popular benchmarks raising the question of how…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Ali Borji , Seyed Mehdi Iranmanesh

Due to the vulnerability of deep neural networks to adversarial examples, numerous works on adversarial attacks and defenses have been burgeoning over the past several years. However, there seem to be some conventional views regarding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Mohammad Nayeem Teli , Seungwon Oh

In the realm of novelty detection, accurately identifying outliers in data without specific class information poses a significant challenge. While current methods excel in single-object scenarios, they struggle with multi-object situations…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mohammadreza Salehi , Nikolaos Apostolikas , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

Traditional LiDAR-based object detection research primarily focuses on closed-set scenarios, which falls short in complex real-world applications. Directly transferring existing 2D open-vocabulary models with some known LiDAR classes for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hu Zhang , Jianhua Xu , Tao Tang , Haiyang Sun , Xin Yu , Zi Huang , Kaicheng Yu

Object recognition is among the fundamental tasks in the computer vision applications, paving the path for all other image understanding operations. In every stage of progress in object recognition research, efforts have been made to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Aria Salari , Abtin Djavadifar , Xiangrui Liu , Homayoun Najjaran

Intelligent object detection, which extracts crucial information like targets categories and locations, plays a vital role in emerging technologies including autonomous driving, the Internet of Things, and next-generation mobile…