English
Related papers

Related papers: Dual-Level Collaborative Transformer for Image Cap…

200 papers

Cross-subject motor-imagery decoding remains a major challenge in EEG-based brain-computer interfaces. To mitigate strong inter-subject variability, recent work has emphasized manifold-based approaches operating on covariance…

Machine Learning · Computer Science 2026-01-30 Sanjeev Manivannan , Chandrashekar Lakshminarayan

Accurate medical image segmentation requires effective modeling of both long-range dependencies and fine-grained boundary details. While transformers mitigate the issue of insufficient semantic information arising from the limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yanxin Li , Hui Wan , Libin Lan

Weakly supervised semantic segmentation (WSSS), which aims to mine the object regions by merely using class-level labels, is a challenging task in computer vision. The current state-of-the-art CNN-based methods usually adopt…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Dongjian Huo , Yukun Su , Qingyao Wu

This paper introduces a novel attention mechanism, called dual attention, which is both efficient and effective. The dual attention mechanism consists of two parallel components: local attention generated by Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhengkai Jiang , Liang Liu , Jiangning Zhang , Yabiao Wang , Mingang Chen , Chengjie Wang

Image captioning models typically follow an encoder-decoder architecture which uses abstract image feature vectors as input to the encoder. One of the most successful algorithms uses feature vectors extracted from the region proposals…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Simao Herdade , Armin Kappeler , Kofi Boakye , Joao Soares

Image captioning is one of the most challenging tasks in AI, which aims to automatically generate textual sentences for an image. Recent methods for image captioning follow encoder-decoder framework that transforms the sequence of salient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Zeliang Song , Xiaofei Zhou

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

The ability to generate natural language explanations conditioned on the visual perception is a crucial step towards autonomous agents which can explain themselves and communicate with humans. While the research efforts in image and video…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Image captioning creates informative text from an input image by creating a relationship between the words and the actual content of an image. Recently, deep learning models that utilize transformers have been the most successful in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Israa Al Badarneh , Bassam Hammo , Omar Al-Kadi

We consider referring image segmentation. It is a problem at the intersection of computer vision and natural language understanding. Given an input image and a referring expression in the form of a natural language sentence, the goal is to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Linwei Ye , Zhi Liu , Yang Wang

Deep neural networks are playing an important role in state-of-the-art visual recognition. To represent high-level visual concepts, modern networks are equipped with large convolutional layers, which use a large number of filters and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Yan Wang , Lingxi Xie , Ya Zhang , Wenjun Zhang , Alan Yuille

Previous studies have demonstrated the effectiveness of point-based neural models on the point cloud analysis task. However, there remains a crucial issue on producing the efficient input embedding for raw point coordinates. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Zihao Li , Pan Gao , Kang You , Chuan Yan , Manoranjan Paul

Most current image captioning models typically generate captions from left-to-right. This unidirectional property makes them can only leverage past context but not future context. Though refinement-based models can exploit both past and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zijie Song , Yuanen Zhou , Zhenzhen Hu , Daqing Liu , Huixia Ben , Richang Hong , Meng Wang

We present a novel method for local image feature matching. Instead of performing image feature detection, description, and matching sequentially, we propose to first establish pixel-wise dense matches at a coarse level and later refine the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jiaming Sun , Zehong Shen , Yuang Wang , Hujun Bao , Xiaowei Zhou

Guided depth super-resolution (GDSR) is an essential topic in multi-modal image processing, which reconstructs high-resolution (HR) depth maps from low-resolution ones collected with suboptimal conditions with the help of HR RGB images of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zixiang Zhao , Jiangshe Zhang , Shuang Xu , Zudi Lin , Hanspeter Pfister

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

In this paper, we present a novel neural network using multi scale feature fusion at various scales for accurate and efficient semantic image segmentation. We used ResNet based feature extractor, dilated convolutional layers in downsampling…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Abhinav Sagar , RajKumar Soundrapandiyan

Recently, the attention-enriched encoder-decoder framework has aroused great interest in image captioning due to its overwhelming progress. Many visual attention models directly leverage meaningful regions to generate image descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Mozhgan Pourkeshavarz , Shahabedin Nabavi , Mohsen Ebrahimi Moghaddam , Mehrnoush Shamsfard

Image matching that finding robust and accurate correspondences across images is a challenging task under extreme conditions. Capturing local and global features simultaneously is an important way to mitigate such an issue but recent…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Wenhao Zhong , Jie Jiang

Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kaixuan Lu , Xiao Huang