English
Related papers

Related papers: Referring Expression Comprehension Using Language …

200 papers

Referring Expression Comprehension (REC) is a crucial cross-modal task that objectively evaluates the capabilities of language understanding, image comprehension, and language-to-image grounding. Consequently, it serves as an ideal testing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Junzhuo Liu , Xuzheng Yang , Weiwei Li , Peng Wang

Referring expressions are natural language descriptions that identify a particular object within a scene and are widely used in our daily conversations. In this work, we focus on segmenting the object in an image specified by a referring…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Yi-Wen Chen , Yi-Hsuan Tsai , Tiantian Wang , Yen-Yu Lin , Ming-Hsuan Yang

Referring expression comprehension (REC) and segmentation (RES) are two highly-related tasks, which both aim at identifying the referent according to a natural language expression. In this paper, we propose a novel Multi-task Collaborative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Liujuan Cao , Chenglin Wu , Cheng Deng , Rongrong Ji

As an important and challenging problem in vision-language tasks, referring expression comprehension (REC) generally requires a large amount of multi-grained information of visual and linguistic modalities to realize accurate reasoning. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Peihan Miao , Wei Su , Gaoang Wang , Xuewei Li , Xi Li

Referring Expression Segmentation (RES) aims to generate a segmentation mask for the object described by a given language expression. Existing classic RES datasets and methods commonly support single-target expressions only, i.e., one…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Chang Liu , Henghui Ding , Xudong Jiang

Referring expression comprehension (REC) aims to localize a target object within an image based on a given expression. Although recent advances in vision-language models have led to substantial improvements in REC tasks, current REC…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zongjian Wu , Lei Zhang

Referring expression counting (REC) algorithms are for more flexible and interactive counting ability across varied fine-grained text expressions. However, the requirement for fine-grained attribute understanding poses challenges for prior…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhicheng Wang , Zhiyu Pan , Zhan Peng , Jian Cheng , Liwen Xiao , Wei Jiang , Zhiguo Cao

Visual grounding tasks, such as referring image segmentation (RIS) and referring expression comprehension (REC), aim to localize a target object based on a given textual description. The target object in an image can be described in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Seonghoon Yu , Junbeom Hong , Joonseok Lee , Jeany Son

Referring Expression Comprehension (REC) aims to identify a particular object in a scene by a natural language expression, and is an important topic in visual language understanding. State-of-the-art methods for this task are based on deep…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Luca Parolari , Elena Izzo , Lamberto Ballan

The task in referring expression comprehension is to localise the object instance in an image described by a referring expression phrased in natural language. As a language-to-vision matching task, the key to this problem is to learn a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Peng Wang , Qi Wu , Jiewei Cao , Chunhua Shen , Lianli Gao , Anton van den Hengel

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Referring Expression Segmentation (RES) has attracted rising attention, aiming to identify and segment objects based on natural language expressions. While substantial progress has been made in RES, the emergence of Generalized Referring…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Weize Li , Zhicheng Zhao , Haochen Bai , Fei Su

Referring Expression Comprehension (REC) aims to localize an image region of a given object described by a natural-language expression. While promising performance has been demonstrated, existing REC algorithms make a strong assumption that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Heng Tao Shen , Cheng Chen , Peng Wang , Lianli Gao , Meng Wang , Jingkuan Song

Change detection in remote sensing imagery is essential for applications such as urban planning, environmental monitoring, and disaster management. Traditional change detection methods typically identify all changes between two temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yilmaz Korkmaz , Jay N. Paranjape , Celso M. de Melo , Vishal M. Patel

The task of multimodal referring expression comprehension (REC), aiming at localizing an image region described by a natural language expression, has recently received increasing attention within the research comminity. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Zhang , Helen Yannakoudakis , Xiantong Zhen , Ekaterina Shutova

Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal LLMs but remain weak tests of visual reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihua Dong , Kuo Yang , Lin Ju , Handong Zhao , Yitian Zhang , Yizhou Wang , Huimin Zeng , Jianglin Lu , Yun Fu

Most of the existing work in one-stage referring expression comprehension (REC) mainly focuses on multi-modal fusion and reasoning, while the influence of other factors in this task lacks in-depth exploration. To fill this gap, we conduct…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Gen Luo , Yiyi Zhou , Jiamu Sun , Xiaoshuai Sun , Rongrong Ji

In this paper, we address referring expression comprehension: localizing an image region described by a natural language expression. While most recent work treats expressions as a single unit, we propose to decompose them into three modular…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Licheng Yu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Mohit Bansal , Tamara L. Berg

Referring expression comprehension aims to localize the object instance described by a natural language expression. Current referring expression methods have achieved good performance. However, none of them is able to achieve real-time…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Yue Liao , Si Liu , Guanbin Li , Fei Wang , Yanjie Chen , Chen Qian , Bo Li

Referring Expression Comprehension (REC), which aims to ground a local visual region via natural language, is a task that heavily relies on multimodal alignment. Most existing methods utilize powerful pre-trained models to transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ting Liu , Zunnan Xu , Yue Hu , Liangtao Shi , Zhiqiang Wang , Quanjun Yin