English
Related papers

Related papers: Towards Local Visual Modeling for Image Captioning

200 papers

Deep network-based image Compressed Sensing (CS) has attracted much attention in recent years. However, the existing deep network-based CS schemes either reconstruct the target image in a block-by-block manner that leads to serious block…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 Wenxue Cui , Shaohui Liu , Feng Jiang , Debin Zhao

Transformer has been widely used for self-supervised pre-training in Natural Language Processing (NLP) and achieved great success. However, it has not been fully explored in visual self-supervised learning. Meanwhile, previous methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhaowen Li , Zhiyang Chen , Fan Yang , Wei Li , Yousong Zhu , Chaoyang Zhao , Rui Deng , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Remote Sensing Image Change Captioning (RSICC) aims to generate spatially grounded natural language descriptions of scene evolution from bi-temporal imagery, moving beyond binary change masks toward semantic-level understanding. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yupeng Gao , Tianyu Li , Guoqing Wang , Yang Yang

Image captioning is a significant field across computer vision and natural language processing. We propose and present AIC-AB NET, a novel Attribute-Information-Combined Attention-Based Network that combines spatial attention architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Guoyun Tu , Ying Liu , Vladimir Vlassov

Visual attention modeling has recently gained momentum in developing visual hierarchies provided by Convolutional Neural Networks. Despite recent successes of feedforward processing on the abstraction of concepts form raw images, the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Mahdi Biparva , John Tsotsos

We propose to Transform Scene Graphs (TSG) into more descriptive captions. In TSG, we apply multi-head attention (MHA) to design the Graph Neural Network (GNN) for embedding scene graphs. After embedding, different graph embeddings contain…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xu Yang , Jiawei Peng , Zihua Wang , Haiyang Xu , Qinghao Ye , Chenliang Li , Songfang Huang , Fei Huang , Zhangzikang Li , Yu Zhang

We present a novel method for local image feature matching. Instead of performing image feature detection, description, and matching sequentially, we propose to first establish pixel-wise dense matches at a coarse level and later refine the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jiaming Sun , Zehong Shen , Yuang Wang , Hujun Bao , Xiaowei Zhou

Convolutional Neural Network (CNN) has been widely used in unstructured datasets, one of which is image denoising. Image denoising is a noisy image reconstruction process that aims to reduce additional noise that occurs from the noisy image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Bintang Pradana Erlangga Putra , Heri Prasetyo , Esti Suryani

Image-text matching has been a hot research topic bridging the vision and language areas. It remains challenging because the current representation of image usually lacks global semantic concepts as in its corresponding text caption. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kunpeng Li , Yulun Zhang , Kai Li , Yuanyuan Li , Yun Fu

Enhancing the quality of low-light images plays a very important role in many image processing and multimedia applications. In recent years, a variety of deep learning techniques have been developed to address this challenging task. A…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Long Ma , Risheng Liu , Jiaao Zhang , Xin Fan , Zhongxuan Luo

Environmental perception systems are crucial for high-precision mapping and autonomous navigation, with LiDAR serving as a core sensor providing accurate 3D point cloud data. Efficiently processing unstructured point clouds while extracting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chuang Chen , Yi Lin , Bo Wang , Jing Hu , Xi Wu , Wenyi Ge

As a unique classification scheme for urban forms and functions, the local climate zone (LCZ) system provides essential general information for any studies related to urban environments, especially on a large scale. Remote sensing…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Chunping Qiu , Xiaochong Tong , Michael Schmitt , Benjamin Bechtel , Xiao Xiang Zhu

Long-range dependency modeling has been widely considered in modern deep learning based semantic segmentation methods, especially those designed for large-size remote sensing images, to compensate the intrinsic locality of standard…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Dawen Yu , Shunping Ji

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

Visual captioning aims to generate textual descriptions given images or videos. Traditionally, image captioning models are trained on human annotated datasets such as Flickr30k and MS-COCO, which are limited in size and diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Marimuthu Kalimuthu , Aditya Mogadala , Marius Mosbach , Dietrich Klakow

We propose "Areas of Attention", a novel attention-based model for automatic image captioning. Our approach models the dependencies between image regions, caption words, and the state of an RNN language model, using three pairwise…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Marco Pedersoli , Thomas Lucas , Cordelia Schmid , Jakob Verbeek

The goal of unpaired image-to-image translation is to produce an output image reflecting the target domain's style while keeping unrelated contents of the input source image unchanged. However, due to the lack of attention to the content…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Guanglei Yang , Hao Tang , Humphrey Shi , Mingli Ding , Nicu Sebe , Radu Timofte , Luc Van Gool , Elisa Ricci

Convolutional Neural Networks (CNNs) have been used extensively for computer vision tasks and produce rich feature representation for objects or parts of an image. But reasoning about scenes requires integration between the low-level…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Syed Ashar Javed , Anil Kumar Nelakanti

Convolutional neural networks (CNN) have recently achieved remarkable successes in various image classification and understanding tasks. The deep features obtained at the top fully-connected layer of the CNN (FC-features) exhibit rich…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Sheng Guo , Weilin Huang , Limin Wang , Yu Qiao
‹ Prev 1 3 4 5 6 7 10 Next ›