中文
相关论文

相关论文: Top-Down Semantic Refinement for Image Captioning

200 篇论文

High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency.…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Liupeng Li , Haoqian Kang , Zhenyu Lu , Jinpeng Wang , Bin Chen , Ke Chen , Yaowei Wang

Cross-modal drone navigation remains a challenging task in robotics, requiring efficient retrieval of relevant images from large-scale databases based on natural language descriptions. The RoboSense 2025 Track 4 challenge addresses this…

机器人学 · 计算机科学 2025-11-07 Lingfeng Zhang , Erjia Xiao , Yuchen Zhang , Haoxiang Fu , Ruibin Hu , Yanbiao Ma , Wenbo Ding , Long Chen , Hangjun Ye , Xiaoshuai Hao

Vision-Language Pre-training (VLP) models like CLIP have significantly advanced Remote Sensing Image-Text Retrieval (RSITR). However, existing methods predominantly rely on coarse-grained global alignment, which often overlooks the dense,…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Yifan Li , Shiying Wang , Jianqiang Huang

Systems such as video chatbots and navigation robots often depend on streaming image captioning to interpret visual inputs. Existing approaches typically employ large multimodal language models (MLLMs) for this purpose, but their…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Junha Song , Yongsik Jo , So Yeon Min , Quanting Xie , Taehwan Kim , Yonatan Bisk , Jaegul Choo

Despite the success of deep learning on many fronts especially image and speech, its application in text classification often is still not as good as a simple linear SVM on n-gram TF-IDF representation especially for smaller datasets. Deep…

计算与语言 · 计算机科学 2017-05-31 Zhenzhou Wu , Xin Zheng , Daniel Dahlmeier

Multimodal Large Language Models (MLLMs) have shown exceptional capabilities in vision-language tasks; however, effectively integrating image segmentation into these models remains a significant challenge. In this paper, we introduce…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Mengcheng Lan , Chaofeng Chen , Yue Zhou , Jiaxing Xu , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

Video captioning can be used to assess the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, existing benchmarks and evaluation protocols suffer from crucial issues, such as inadequate or homogeneous…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Linhao Yu , Xinguang Ji , Yahui Liu , Fanheng Kong , Chenxi Sun , Jingyuan Zhang , Hongzhi Zhang , V. W. , Fuzheng Zhang , Deyi Xiong

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

Image captioning is a fundamental task that bridges the visual and linguistic domains, playing a critical role in pre-training Large Vision-Language Models (LVLMs). Current state-of-the-art captioning models are typically trained with…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Long Xing , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jianze Liang , Qidong Huang , Jiaqi Wang , Feng Wu , Dahua Lin

Vision Language Models (VLMs) are becoming increasingly integral to multimedia understanding; however, they often struggle with domain-specific video classification tasks, particularly in cases with limited data. This stems from a critical…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Meilong Xu , Di Fu , Jiaxing Zhang , Gong Yu , Jiayu Zheng , Xiaoling Hu , Dongdi Zhao , Feiyang Li , Chao Chen , Yong Cao

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Carlos Rebelo , Gil Rocha , João Daniel Silva , Bruno Martins

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Visual-Language Models (VLMs) have achieved remarkable progress in image captioning, visual question answering, and visual reasoning. Yet they remain prone to vision-language misalignment, often producing overly generic or hallucinated…

Despite significant advancements, large multimodal models (LMMs) still struggle to bridge the gap between low-level visual perception -- focusing on shapes, sizes, and layouts -- and high-level language reasoning, such as semantics and…

计算与语言 · 计算机科学 2025-06-13 Zhenhailong Wang , Joy Hsu , Xingyao Wang , Kuan-Hao Huang , Manling Li , Jiajun Wu , Heng Ji

Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to…

Despite rapid advancements, current text-to-image (T2I) models predominantly rely on a single-step generation paradigm, which struggles with complex semantics and faces diminishing returns from parameter scaling. While recent multi-step…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Hanbo Cheng , Limin Lin , Ruo Zhang , Yicheng Pan , Jun Du

The visual commonsense reasoning (VCR) task is to choose an answer and provide a justifying rationale based on the given image and textural question. Representative works first recognize objects in images and then associate them with key…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Jian Zhu , Hanli Wang , Miaojing Shi

Convolutional Neural Networks (CNNs) have significantly advanced Image Super-Resolution (SR), yet most CNN-based methods rely solely on pixel-based transformations, often leading to artifacts and blurring, particularly under severe…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Bingwen Hu , Heng Liu , Zhedong Zheng , Ping Liu

The burgeoning field of generative artificial intelligence has fundamentally reshaped our approach to content creation, with Large Vision-Language Models (LVLMs) standing at its forefront. While current LVLMs have demonstrated impressive…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Spencer Ramsey , Jeffrey Lee , Amina Grant

Visual Place Recognition (VPR) has evolved from handcrafted descriptors to deep learning approaches, yet significant challenges remain. Current approaches, including Vision Foundation Models (VFMs) and Multimodal Large Language Models…

机器学习 · 计算机科学 2025-09-03 Jintao Cheng , Weibin Li , Jiehao Luo , Xiaoyu Tang , Zhijian He , Jin Wu , Yao Zou , Wei Zhang