中文
相关论文

相关论文: Referring Expression Comprehension Using Language …

200 篇论文

Referring object detection and referring image segmentation are important tasks that require joint understanding of visual information and natural language. Yet there has been evidence that current benchmark datasets suffer from bias, and…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Runtao Liu , Chenxi Liu , Yutong Bai , Alan Yuille

Referring Expression Comprehension (REC) has become one of the most important tasks in visual reasoning, since it is an essential step for many vision-and-language tasks such as visual question answering. However, it has not been widely…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Wei Suo , Mengyang Sun , Peng Wang , Qi Wu

Referring Expression Generation (REG) is the task of generating contextually appropriate references to entities. A limitation of existing REG systems is that they rely on entity-specific supervised training, which means that they cannot…

计算与语言 · 计算机科学 2019-09-05 Meng Cao , Jackie Chi Kit Cheung

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Referring Image Segmentation (RIS) is a fundamental vision-language task that outputs object masks based on text descriptions. Many works have achieved considerable progress for RIS, including different fusion method designs. In this work,…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Jianzong Wu , Xiangtai Li , Xia Li , Henghui Ding , Yunhai Tong , Dacheng Tao

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion.…

计算与语言 · 计算机科学 2023-08-24 Yerong Li , Roxana Girju

We present REM, a framework for segmenting a wide range of concepts in video that can be described through natural language. Our method leverages the universal visual-language mapping learned by video diffusion models on Internet-scale data…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Anurag Bagchi , Zhipeng Bao , Yu-Xiong Wang , Pavel Tokmakov , Martial Hebert

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang

To enhance the interpretability of Reinforcement Learning (RL), we propose Revealing Evolutionary Action Consequence Trajectories (REACT). In contrast to the prevalent practice of validating RL models based on their optimal behavior learned…

Generalized Referring expressions can describe one object, several related objects, or none at all. Existing generalized referring segmentation (GRES) models treat all cases alike, predicting a single binary mask and ignoring how linguistic…

计算机视觉与模式识别 · 计算机科学 2026-03-26 E-Ro Nguyen , Hieu Le , Dimitris Samaras , Michael S. Ryoo

Referring video object segmentation aims to segment a referent throughout a video sequence according to a natural language expression. It requires aligning the natural language expression with the objects' motions and their dynamic…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Jiajin Tang , Ge Zheng , Sibei Yang

Referring Expression Segmentation (RES) is a core vision-language segmentation task that enables pixel-level understanding of targets via free-form linguistic expressions, supporting critical applications such as human-robot interaction and…

计算机视觉与模式识别 · 计算机科学 2026-01-26 Yihao Wang , Jusheng Zhang , Ziyi Tang , Keze Wang , Meng Yang

Unlike prevalent facial expressions, micro expressions have subtle, involuntary muscle movements which are short-lived in nature. These minute muscle movements reflect true emotions of a person. Due to the short duration and low intensity,…

计算机视觉与模式识别 · 计算机科学 2020-01-08 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh , Subrahmanyam Murala

Referring expression segmentation (RES), a task that involves localizing specific instance-level objects based on free-form linguistic descriptions, has emerged as a crucial frontier in human-AI interaction. It demands an intricate…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Ying Zang , Chenglong Fu , Runlong Cao , Didi Zhu , Min Zhang , Wenjun Hu , Lanyun Zhu , Tianrun Chen

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Embodied perception is essential for intelligent vehicles and robots in interactive environmental understanding. However, these advancements primarily focus on vision, with limited attention given to using 3D modeling sensors, restricting a…

Referring image segmentation aims at segmenting the foreground masks of the entities that can well match the description given in the natural language expression. Previous approaches tackle this problem using implicit feature interaction…

计算机视觉与模式识别 · 计算机科学 2020-10-02 Shaofei Huang , Tianrui Hui , Si Liu , Guanbin Li , Yunchao Wei , Jizhong Han , Luoqi Liu , Bo Li

Reference Expression Generation (REG) and Comprehension (REC) are two highly correlated tasks. Modeling REG and REC simultaneously for utilizing the relation between them is a promising way to improve both. However, the problem of distinct…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Duo Zheng , Tao Kong , Ya Jing , Jiaan Wang , Xiaojie Wang

Symbolic regression (SR) aims to discover closed-form mathematical expressions that accurately describe data, offering interpretability and analytical insight beyond standard black-box models. Existing SR methods often rely on…

机器学习 · 计算机科学 2025-06-17 Mansooreh Montazerin , Majd Al Aawar , Antonio Ortega , Ajitesh Srivastava