English
Related papers

Related papers: Top-Down Semantic Refinement for Image Captioning

200 papers

High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Liupeng Li , Haoqian Kang , Zhenyu Lu , Jinpeng Wang , Bin Chen , Ke Chen , Yaowei Wang

Cross-modal drone navigation remains a challenging task in robotics, requiring efficient retrieval of relevant images from large-scale databases based on natural language descriptions. The RoboSense 2025 Track 4 challenge addresses this…

Vision-Language Pre-training (VLP) models like CLIP have significantly advanced Remote Sensing Image-Text Retrieval (RSITR). However, existing methods predominantly rely on coarse-grained global alignment, which often overlooks the dense,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifan Li , Shiying Wang , Jianqiang Huang

Systems such as video chatbots and navigation robots often depend on streaming image captioning to interpret visual inputs. Existing approaches typically employ large multimodal language models (MLLMs) for this purpose, but their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Junha Song , Yongsik Jo , So Yeon Min , Quanting Xie , Taehwan Kim , Yonatan Bisk , Jaegul Choo

Despite the success of deep learning on many fronts especially image and speech, its application in text classification often is still not as good as a simple linear SVM on n-gram TF-IDF representation especially for smaller datasets. Deep…

Computation and Language · Computer Science 2017-05-31 Zhenzhou Wu , Xin Zheng , Daniel Dahlmeier

Multimodal Large Language Models (MLLMs) have shown exceptional capabilities in vision-language tasks; however, effectively integrating image segmentation into these models remains a significant challenge. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Mengcheng Lan , Chaofeng Chen , Yue Zhou , Jiaxing Xu , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

Video captioning can be used to assess the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, existing benchmarks and evaluation protocols suffer from crucial issues, such as inadequate or homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Linhao Yu , Xinguang Ji , Yahui Liu , Fanheng Kong , Chenxi Sun , Jingyuan Zhang , Hongzhi Zhang , V. W. , Fuzheng Zhang , Deyi Xiong

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

Image captioning is a fundamental task that bridges the visual and linguistic domains, playing a critical role in pre-training Large Vision-Language Models (LVLMs). Current state-of-the-art captioning models are typically trained with…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Long Xing , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jianze Liang , Qidong Huang , Jiaqi Wang , Feng Wu , Dahua Lin

Vision Language Models (VLMs) are becoming increasingly integral to multimedia understanding; however, they often struggle with domain-specific video classification tasks, particularly in cases with limited data. This stems from a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Meilong Xu , Di Fu , Jiaxing Zhang , Gong Yu , Jiayu Zheng , Xiaoling Hu , Dongdi Zhao , Feiyang Li , Chao Chen , Yong Cao

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Carlos Rebelo , Gil Rocha , João Daniel Silva , Bruno Martins

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Visual-Language Models (VLMs) have achieved remarkable progress in image captioning, visual question answering, and visual reasoning. Yet they remain prone to vision-language misalignment, often producing overly generic or hallucinated…

Despite significant advancements, large multimodal models (LMMs) still struggle to bridge the gap between low-level visual perception -- focusing on shapes, sizes, and layouts -- and high-level language reasoning, such as semantics and…

Computation and Language · Computer Science 2025-06-13 Zhenhailong Wang , Joy Hsu , Xingyao Wang , Kuan-Hao Huang , Manling Li , Jiajun Wu , Heng Ji

Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Cheng Cui , Ting Sun , Suyin Liang , Tingquan Gao , Zelun Zhang , Jiaxuan Liu , Xueqing Wang , Changda Zhou , Hongen Liu , Manhui Lin , Yue Zhang , Yubo Zhang , Jing Zhang , Jun Zhang , Xing Wei , Yi Liu , Dianhai Yu , Yanjun Ma

Despite rapid advancements, current text-to-image (T2I) models predominantly rely on a single-step generation paradigm, which struggles with complex semantics and faces diminishing returns from parameter scaling. While recent multi-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hanbo Cheng , Limin Lin , Ruo Zhang , Yicheng Pan , Jun Du

The visual commonsense reasoning (VCR) task is to choose an answer and provide a justifying rationale based on the given image and textural question. Representative works first recognize objects in images and then associate them with key…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jian Zhu , Hanli Wang , Miaojing Shi

Convolutional Neural Networks (CNNs) have significantly advanced Image Super-Resolution (SR), yet most CNN-based methods rely solely on pixel-based transformations, often leading to artifacts and blurring, particularly under severe…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Bingwen Hu , Heng Liu , Zhedong Zheng , Ping Liu

The burgeoning field of generative artificial intelligence has fundamentally reshaped our approach to content creation, with Large Vision-Language Models (LVLMs) standing at its forefront. While current LVLMs have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Spencer Ramsey , Jeffrey Lee , Amina Grant

Visual Place Recognition (VPR) has evolved from handcrafted descriptors to deep learning approaches, yet significant challenges remain. Current approaches, including Vision Foundation Models (VFMs) and Multimodal Large Language Models…

Machine Learning · Computer Science 2025-09-03 Jintao Cheng , Weibin Li , Jiehao Luo , Xiaoyu Tang , Zhijian He , Jin Wu , Yao Zou , Wei Zhang