English
Related papers

Related papers: Referring to Any Person

200 papers

Person search has drawn increasing attention due to its real-world applications and research significance. Person search aims to find a probe person in a gallery of scene images with a wide range of applications, such as criminals search,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Xiangtan Lin , Pengzhen Ren , Yun Xiao , Xiaojun Chang , Alex Hauptmann

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Entity Coreference Resolution is the task of resolving all mentions in a document that refer to the same real world entity and is considered as one of the most difficult tasks in natural language understanding. It is of great importance for…

Computation and Language · Computer Science 2020-12-10 Nikolaos Stylianou , Ioannis Vlahavas

Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal LLMs but remain weak tests of visual reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihua Dong , Kuo Yang , Lin Ju , Handong Zhao , Yitian Zhang , Yizhou Wang , Huimin Zeng , Jianglin Lu , Yun Fu

In this work, we address the challenging task of referring segmentation. The query expression in referring segmentation typically indicates the target object by describing its relationship with others. Therefore, to find the target one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Henghui Ding , Chang Liu , Suchen Wang , Xudong Jiang

Referring expression comprehension aims to localize objects identified by natural language descriptions. This is a challenging task as it requires understanding of both visual and language domains. One nature is that each object can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yi-Wen Chen , Yi-Hsuan Tsai , Ming-Hsuan Yang

Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wei Su , Peihan Miao , Huanzhang Dou , Xi Li

Object recognition is among the fundamental tasks in the computer vision applications, paving the path for all other image understanding operations. In every stage of progress in object recognition research, efforts have been made to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Aria Salari , Abtin Djavadifar , Xiangrui Liu , Homayoun Najjaran

We demonstrate that large multimodal language models differ substantially from humans in the distribution of coreferential expressions in a visual storytelling task. We introduce a number of metrics to quantify the characteristics of…

Computation and Language · Computer Science 2025-06-23 Nikolai Ilinykh , Shalom Lappin , Asad Sayeed , Sharid Loáiciga

Referring Expression Counting (REC) extends class-level object counting to the fine-grained subclass-level, aiming to enumerate objects matching a textual expression that specifies both the class and distinguishing attribute. A fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yuda Zou , Zijian Zhang , Yongchao Xu

Referring image segmentation, the task of segmenting any arbitrary entities described in free-form texts, opens up a variety of vision applications. However, manual labeling of training data for this task is prohibitively costly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Dongwon Kim , Namyup Kim , Cuiling Lan , Suha Kwak

We investigate the problem of object referring (OR) i.e. to localize a target object in a visual scene coming with a language description. Humans perceive the world more as continued video snippets than as static images, and describe…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Arun Balajee Vasudevan , Dengxin Dai , Luc Van Gool

Text-based person retrieval aims to identify a target individual from an image gallery using a natural language description. Existing methods primarily focus on appearance-driven cross-modal retrieval, yet face significant challenges due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yingjia Xu , Jinlin Wu , Daming Gao , Zhen Chen , Yang Yang , Min Cao , Mang Ye , Zhen Lei

Person re-identification (Re-ID) is a crucial task in computer vision, aiming to recognize individuals across non-overlapping camera views. While recent advanced vision-language models (VLMs) excel in logical reasoning and multi-task…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ke Niu , Haiyang Yu , Mengyang Zhao , Teng Fu , Siyang Yi , Wei Lu , Bin Li , Xuelin Qian , Xiangyang Xue

Recent advancement of research in biometrics, computer vision, and natural language processing has discovered opportunities for person retrieval from surveillance videos using textual query. The prime objective of a surveillance system is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Hiren Galiyawala , Mehul S Raval

Human is one of the most essential classes in visual recognition tasks such as detection, segmentation, and pose estimation. Although much effort has been put into individual tasks, multi-task learning for these three tasks has been rarely…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Hyeongseok Son , Sangil Jung , Solae Lee , Seongeun Kim , Seung-In Park , ByungIn Yoo

Recognizing the identities of people in everyday photos is still a very challenging problem for machine vision, due to non-frontal faces, changes in clothing, location, lighting and similar. Recent studies have shown that rich relational…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Yao Li , Guosheng Lin , Bohan Zhuang , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Referenceless metrics (e.g., CLIPScore) use pretrained vision--language models to assess image descriptions directly without costly ground-truth reference texts. Such methods can facilitate rapid progress, but only if they truly align with…

Computation and Language · Computer Science 2023-09-22 Elisa Kreiss , Eric Zelikman , Christopher Potts , Nick Haber

Relevance plays a central role in information retrieval (IR), which has received extensive studies starting from the 20th century. The definition and the modeling of relevance has always been critical challenges in both information science…

Information Retrieval · Computer Science 2021-03-02 Yixing Fan , Jiafeng Guo , Xinyu Ma , Ruqing Zhang , Yanyan Lan , Xueqi Cheng

Person Search is a relevant task that aims to jointly solve Person Detection and Person Re-identification(re-ID). Though most previous methods focus on learning robust individual features for retrieval, it's still hard to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Shihui Chen , Yueqing Zhuang , Boxun Li