English
Related papers

Related papers: JSSFF: A Joint Structural-Semantic Fusion Framewor…

200 papers

Automated textual description of remote sensing images is crucial for unlocking their full potential in diverse applications, from environmental monitoring to urban planning and disaster management. However, existing studies in remote…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Kaiyu Li , Zixuan Jiang , Xiangyong Cao , Jiayu Wang , Yuchen Xiao , Deyu Meng , Zhi Wang

The encode-decoder framework has shown recent success in image captioning. Visual attention, which is good at detailedness, and semantic attention, which is good at comprehensiveness, have been separately proposed to ground the caption on…

Computation and Language · Computer Science 2018-08-28 Fenglin Liu , Xuancheng Ren , Yuanxin Liu , Houfeng Wang , Xu Sun

Extracting context from visual representations is of utmost importance in the advancement of Computer Science. Representation of such a format in Natural Language has a huge variety of applications such as helping the visually impaired etc.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Madhavan Seshadri , Malavika Srikanth , Mikhail Belov

Remarkable progress has been achieved in image generation with the introduction of generative models. However, precisely controlling the content in generated images remains a challenging task due to their fundamental training objective.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Giang H. Le , Anh Q. Nguyen , Byeongkeun Kang , Yeejin Lee

Image semantic segmentation aims at the pixel-level classification of images, which has requirements for both accuracy and speed in practical application. Existing semantic segmentation methods mainly rely on the high-resolution input to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Tianjiao Jiang , Yi Jin , Tengfei Liang , Xu Wang , Yidong Li

Image captioning by the encoder-decoder framework has shown tremendous advancement in the last decade where CNN is mainly used as encoder and LSTM is used as a decoder. Despite such an impressive achievement in terms of accuracy in simple…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Rana Adnan Ahmad , Muhammad Azhar , Hina Sattar

Deep learning based image compressed sensing (CS) has achieved great success. However, existing CS systems mainly adopt a fixed measurement matrix to images, ignoring the fact the optimal measurement numbers and bases are different for…

Image and Video Processing · Electrical Eng. & Systems 2023-07-12 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. And then we utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Boyuan Ma , Xiaojuan Ban , Haiyou Huang , Yu Zhu

Automatic transcription of scene understanding in images and videos is a step towards artificial general intelligence. Image captioning is a nomenclature for describing meaningful information in an image using computer vision techniques.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Joonmo Kim , Moongu Jeon

For real-time semantic segmentation, how to increase the speed while maintaining high resolution is a problem that has been discussed and solved. Backbone design and fusion design have always been two essential parts of real-time semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Tan Sixiang

Remotely captured images possess an immense scale and object appearance variability due to the complex scene. It becomes challenging to capture the underlying attributes in the global and local context for their segmentation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Satyawant Kumar , Abhishek Kumar , Dong-Gyu Lee

Attention-based encoder-decoder framework is widely used in the scene text recognition task. However, for the current state-of-the-art(SOTA) methods, there is room for improvement in terms of the efficient usage of local visual and global…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Mengmeng Cui , Wei Wang , Jinjin Zhang , Liang Wang

The aim of image captioning is to generate textual description of a given image. Though seemingly an easy task for humans, it is challenging for machines as it requires the ability to comprehend the image (computer vision) and consequently…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Anubhav Shrimal , Tanmoy Chakraborty

Automatic captioning of images is a task that combines the challenges of image analysis and text generation. One important aspect in captioning is the notion of attention: How to decide what to describe and in which order. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sen He , Wentong Liao , Hamed R. Tavakoli , Michael Yang , Bodo Rosenhahn , Nicolas Pugeault

Accurate semantic segmentation of urban remote sensing images (URSIs) is essential for urban planning and environmental monitoring. However, it remains challenging due to the subtle texture differences and similar spatial structures among…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Guoyu Zhou , Jing Zhang , Yi Yan , Hui Zhang , Li Zhuo

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

With the advancement of remote-sensed imaging large volumes of very high resolution land cover images can now be obtained. Automation of object recognition in these 2D images, however, is still a key issue. High intra-class variance and low…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Vikas Agaradahalli Gurumurthy

Remote sensing semantic segmentation requires models that can jointly capture fine spatial details and high-level semantic context across complex scenes. While classical encoder-decoder architectures such as U-Net remain strong baselines,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Md Aminur Hossain , Ayush V. Patel , Siddhant Gole , Sanjay K. Singh , Biplab Banerjee

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

Image captioning model is a cross-modality knowledge discovery task, which targets at automatically describing an image with an informative and coherent sentence. To generate the captions, the previous encoder-decoder frameworks directly…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ziwei Wang , Yadan Luo , Zi Huang