English
Related papers

Related papers: Language-driven Semantic Segmentation

200 papers

Training a neural network model for recognizing multiple labels associated with an image, including identifying unseen labels, is challenging, especially for images that portray numerous semantically diverse labels. As challenging as this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Avi Ben-Cohen , Nadav Zamir , Emanuel Ben Baruch , Itamar Friedman , Lihi Zelnik-Manor

Implicit neural representations (INRs) have achieved remarkable successes in learning expressive yet compact signal representations. However, they are not naturally amenable to predictive tasks such as segmentation, where they must learn…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Kushal Vyas , Ashok Veeraraghavan , Guha Balakrishnan

Multimodal Large Language Models (MLLMs) have shown exceptional capabilities in vision-language tasks. However, effectively integrating image segmentation into these models remains a significant challenge. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Mengcheng Lan , Chaofeng Chen , Jiaxing Xu , Zongrui Li , Yiping Ke , Xudong Jiang , Yingchen Yu , Yunqing Zhao , Song Bai

Language-driven image segmentation is a fundamental task in vision-language understanding, requiring models to segment regions of an image corresponding to natural language expressions. Traditional methods approach this as a discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yuhao Chen , Shubin Chen , Liang Lin , Guangrun Wang

Zero-shot learning (ZSL) makes object recognition in images possible in absence of visual training data for a part of the classes from a dataset. When the number of classes is large, classes are usually represented by semantic class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Yannick Le Cacheux , Adrian Popescu , Hervé Le Borgne

Semantic segmentation is a key computer vision task that has been actively researched for decades. In recent years, supervised methods have reached unprecedented accuracy, however they require many pixel-level annotations for every new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Nir Zabari , Yedid Hoshen

Scaling up the vocabulary of semantic segmentation models is extremely challenging because annotating large-scale mask labels is labour-intensive and time-consuming. Recently, language-guided segmentation models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Haojun Yu , Di Dai , Ziwei Zhao , Di He , Han Hu , Liwei Wang

Text classification is one of the most important and fundamental tasks in natural language processing. Performance of this task mainly dependents on text representation learning. Currently, most existing learning frameworks mainly focus on…

Computation and Language · Computer Science 2020-02-26 Xien Liu , Song Wang , Xiao Zhang , Xinxin You , Ji Wu , Dejing Dou

Semantic segmentation is a powerful method to facilitate visual scene understanding. Each pixel is assigned a label according to a pre-defined list of object classes and semantic entities. This becomes very useful as a means to summarize…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Marc Bosch , Gordon A. Christie , Christopher M. Gifford

Current semantic segmentation methods focus only on mining "local" context, i.e., dependencies between pixels within individual images, by context-aggregation modules (e.g., dilated convolution, neural attention) or structure-aware…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Wenguan Wang , Tianfei Zhou , Fisher Yu , Jifeng Dai , Ender Konukoglu , Luc Van Gool

Translating images from a source domain to a target domain for learning target models is one of the most common strategies in domain adaptive semantic segmentation (DASS). However, existing methods still struggle to preserve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Duo Peng , Ping Hu , Qiuhong Ke , Jun Liu

Image segmentation, the process of partitioning an image into meaningful regions, plays a pivotal role in computer vision and medical imaging applications. Unsupervised segmentation, particularly in the absence of labeled data, remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Kovvuri Sai Gopal Reddy , Bodduluri Saran , A. Mudit Adityaja , Saurabh J. Shigwan , Nitin Kumar

Leveraging multiple training datasets to scale up image segmentation models is beneficial for increasing robustness and semantic understanding. Individual datasets have well-defined ground truth with non-overlapping mask layouts and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Di Liu , Abhishek Aich , Dimitris Metaxas , Samuel Schulter

Neural Architecture Representation Learning aims to transform network models into feature representations for predicting network attributes, playing a crucial role in deploying and designing networks for real-world applications. Recently,…

Machine Learning · Computer Science 2025-06-10 Haizhao Jing , Haokui Zhang , Zhenhao Shang , Rong Xiao , Peng Wang , Yanning Zhang

Semantic segmentation of remote sensing images plays a vital role in a wide range of Earth Observation applications, such as land use land cover mapping, environment monitoring, and sustainable development. Driven by rapid developments in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Libo Wang , Sijun Dong , Ying Chen , Xiaoliang Meng , Shenghui Fang , Songlin Fei

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

The rapid development of deep learning has driven significant progress in image semantic segmentation - a fundamental task in computer vision. Semantic segmentation algorithms often depend on the availability of pixel-level labels (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhaozheng Chen , Qianru Sun

Sketch semantic segmentation is a well-explored and pivotal problem in computer vision involving the assignment of pre-defined part labels to individual strokes. This paper presents ContextSeg - a simple yet highly effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jiawei Wang , Changjian Li

Visual-textual correlations in the attention maps derived from text-to-image diffusion models are proven beneficial to dense visual prediction tasks, e.g., semantic segmentation. However, a significant challenge arises due to the input…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Jiayi Lin , Jiabo Huang , Jian Hu , Shaogang Gong

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks