English
Related papers

Related papers: Semantics-Aware Dynamic Localization and Refinemen…

200 papers

In this paper we are interested in the problem of image segmentation given natural language descriptions, i.e. referring expressions. Existing works tackle this problem by first modeling images and sentences independently and then segment…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chenxi Liu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Alan Yuille

We propose a novel weakly-supervised semantic segmentation algorithm based on Deep Convolutional Neural Network (DCNN). Contrary to existing weakly-supervised approaches, our algorithm exploits auxiliary segmentation annotations available…

Computer Vision and Pattern Recognition · Computer Science 2015-12-29 Seunghoon Hong , Junhyuk Oh , Bohyung Han , Honglak Lee

Referring expressions are natural language descriptions that identify a particular object within a scene and are widely used in our daily conversations. In this work, we focus on segmenting the object in an image specified by a referring…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Yi-Wen Chen , Yi-Hsuan Tsai , Tiantian Wang , Yen-Yu Lin , Ming-Hsuan Yang

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

We address the problem of segmenting an object given a natural language expression that describes it. Current techniques tackle this task by either (\textit{i}) directly or recursively merging linguistic and visual information in the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Edgar Margffoy-Tuay , Juan C. Pérez , Emilio Botero , Pablo Arbeláez

In this paper we propose a novel deep learning-based algorithm for biomedical image segmentation which uses a sequential attention mechanism able to shift the focus of attention across the image in a selective way, allowing subareas which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Shohei Hayashi , Bisser Raytchev , Toru Tamaki , Kazufumi Kaneda

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wei Su , Peihan Miao , Huanzhang Dou , Xi Li

To avoid the exhaustive search over locations and scales, current state-of-the-art object detection systems usually involve a crucial component generating a batch of candidate object proposals from images. In this paper, we present a simple…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Tianshui Chen , Liang Lin , Xian Wu , Nong Xiao , Xiaonan Luo

Object co-segmentation is the task of segmenting the same objects from multiple images. In this paper, we propose the Attention Based Object Co-Segmentation for object co-segmentation that utilize a novel attention mechanism in the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Hong Chen , Yifei Huang , Hideki Nakayama

Image segmentation is a fundamental task in computer vision, aimed at partitioning an image into semantically meaningful regions. Referring image segmentation extends this task by using natural language expressions to localize specific…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Alaa Dalaq , Muzammil Behzad

We propose a novel neural network module that transforms an existing single-frame semantic segmentation model into a video semantic segmentation pipeline. In contrast to prior works, we strive towards a simple, fast, and general module that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Matthieu Paul , Martin Danelljan , Luc Van Gool , Radu Timofte

Recently, referring image segmentation has aroused widespread interest. Previous methods perform the multi-modal fusion between language and vision at the decoding side of the network. And, linguistic feature interacts with visual feature…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Guang Feng , Zhiwei Hu , Lihe Zhang , Huchuan Lu

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang

Learning-based approaches for semantic segmentation have two inherent challenges. First, acquiring pixel-wise labels is expensive and time-consuming. Second, realistic segmentation datasets are highly unbalanced: some categories are much…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Arantxa Casanova , Pedro O. Pinheiro , Negar Rostamzadeh , Christopher J. Pal

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Image segmentation from referring expressions is a joint vision and language modeling task, where the input is an image and a textual expression describing a particular region in the image; and the goal is to localize and segment the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Ronghang Hu , Marcus Rohrbach , Subhashini Venugopalan , Trevor Darrell

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang