English
Related papers

Related papers: Referring Expression Comprehension: A Survey of Me…

200 papers

The task in referring expression comprehension is to localise the object instance in an image described by a referring expression phrased in natural language. As a language-to-vision matching task, the key to this problem is to learn a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Peng Wang , Qi Wu , Jiewei Cao , Chunhua Shen , Lianli Gao , Anton van den Hengel

Referring expression comprehension (REC) aims to localize a text-related region in a given image by a referring expression in natural language. Existing methods focus on how to build convincing visual and language representations…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Shuai Wang , Fan Lyu , Wei Feng , Song Wang

Referring Expression Comprehension (REC) aims to identify a particular object in a scene by a natural language expression, and is an important topic in visual language understanding. State-of-the-art methods for this task are based on deep…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Luca Parolari , Elena Izzo , Lamberto Ballan

Referring expression comprehension aims to locate the object instance described by a natural language referring expression in an image. This task is compositional and inherently requires visual reasoning on top of the relationships among…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Sibei Yang , Guanbin Li , Yizhou Yu

The task of multimodal referring expression comprehension (REC), aiming at localizing an image region described by a natural language expression, has recently received increasing attention within the research comminity. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Zhang , Helen Yannakoudakis , Xiantong Zhen , Ekaterina Shutova

Visual grounding tasks, such as referring image segmentation (RIS) and referring expression comprehension (REC), aim to localize a target object based on a given textual description. The target object in an image can be described in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Seonghoon Yu , Junbeom Hong , Joonseok Lee , Jeany Son

Referring expression counting (REC) algorithms are for more flexible and interactive counting ability across varied fine-grained text expressions. However, the requirement for fine-grained attribute understanding poses challenges for prior…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhicheng Wang , Zhiyu Pan , Zhan Peng , Jian Cheng , Liwen Xiao , Wei Jiang , Zhiguo Cao

AI-driven geometric problem solving is a complex vision-language task that requires accurate diagram interpretation, mathematical reasoning, and robust cross-modal grounding. A foundational yet underexplored capability for this task is the…

Machine Learning · Computer Science 2025-09-26 Bing Liu , Wenqiang Yv , Xuzheng Yang , Shichang Wang , Junzhuo Liu , Peng Wang , Guoqing Wang , Yang Yang , Heng Tao Shen

Referring expressions are natural language descriptions that identify a particular object within a scene and are widely used in our daily conversations. In this work, we focus on segmenting the object in an image specified by a referring…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Yi-Wen Chen , Yi-Hsuan Tsai , Tiantian Wang , Yen-Yu Lin , Ming-Hsuan Yang

Referring Expression Comprehension (REC) is one of the most important tasks in visual reasoning that requires a model to detect the target object referred by a natural language expression. Among the proposed pipelines, the one-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Zhipeng Zhang , Zhimin Wei , Zhongzhen Huang , Rui Niu , Peng Wang

Referring Expression Comprehension (REC) is an emerging research spot in computer vision, which refers to detecting the target region in an image given an text description. Most existing REC methods follow a multi-stage pipeline, which are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yiyi Zhou , Rongrong Ji , Gen Luo , Xiaoshuai Sun , Jinsong Su , Xinghao Ding , Chia-wen Lin , Qi Tian

In this paper, we address referring expression comprehension: localizing an image region described by a natural language expression. While most recent work treats expressions as a single unit, we propose to decompose them into three modular…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Licheng Yu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Mohit Bansal , Tamara L. Berg

Referring expression comprehension (REC) aims at achieving object localization based on natural language descriptions. However, existing REC approaches are constrained by object category descriptions and single-attribute intention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hao Guo , Jianfei Zhu , Wei Fan , Chunzhi Yi , Feng Jiang

We consider generation and comprehension of natural language referring expression for objects in an image. Unlike generic "image captioning" which lacks natural standard evaluation criteria, quality of a referring expression may be measured…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Ruotian Luo , Gregory Shakhnarovich

Reference expression comprehension (REC) aims to find the location that the phrase refer to in a given image. Proposal generation and proposal representation are two effective techniques in many two-stage REC methods. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Chao Yang , Guoqing Wang , Dongsheng Li , Huawei Shen , Su Feng , Bin Jiang

Referring expression comprehension aims to localize objects identified by natural language descriptions. This is a challenging task as it requires understanding of both visual and language domains. One nature is that each object can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yi-Wen Chen , Yi-Hsuan Tsai , Ming-Hsuan Yang

Referring expression segmentation aims to segment an object described by a language expression from an image. Despite the recent progress on this task, existing models tackling this task may not be able to fully capture semantics and visual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Li Xu , Mark He Huang , Xindi Shang , Zehuan Yuan , Ying Sun , Jun Liu

Referring object detection and referring image segmentation are important tasks that require joint understanding of visual information and natural language. Yet there has been evidence that current benchmark datasets suffer from bias, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Runtao Liu , Chenxi Liu , Yutong Bai , Alan Yuille

Object counting has progressed from class-specific models, which count only known categories, to class-agnostic models that generalize to unseen categories. The next challenge is Referring Expression Counting (REC), where the goal is to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Kostas Triaridis , Panagiotis Kaliosis , E-Ro Nguyen , Jingyi Xu , Hieu Le , Dimitris Samaras

Reference Expression Generation (REG) and Comprehension (REC) are two highly correlated tasks. Modeling REG and REC simultaneously for utilizing the relation between them is a promising way to improve both. However, the problem of distinct…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Duo Zheng , Tao Kong , Ya Jing , Jiaan Wang , Xiaojie Wang