中文
相关论文

相关论文: VACoT: Rethinking Visual Data Augmentation with VL…

200 篇论文

Process Reward Model (PRM) is widely used in the post-training of Large Language Model (LLM) because it can perform fine-grained evaluation of the reasoning steps of generated content. However, most PRMs lack long-term reasoning and deep…

机器学习 · 计算机科学 2026-05-22 Xinquan Chen , Chongying Yue , Bangwei Liu , Xuhong Wang , Yingchun Wang , Chaochao Lu

Charts are essential to data analysis, transforming raw data into clear visual representations that support human decision-making. Although current vision-language models (VLMs) have made significant progress, they continue to struggle with…

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

While visual language model architectures and training infrastructures advance rapidly, data curation remains under-explored where quantity and quality become a bottleneck. Existing work either crawls extra Internet data with a loose…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Yunhao Fang , Ligeng Zhu , Yao Lu , Yan Wang , Pavlo Molchanov , Jan Kautz , Jang Hyun Cho , Marco Pavone , Song Han , Hongxu Yin

Capturing spatial relationships from visual inputs is a cornerstone of human-like general intelligence. Several previous studies have tried to enhance the spatial awareness of Vision-Language Models (VLMs) by adding extra expert encoders,…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Rui Yang , Ziyu Zhu , Yanwei Li , Jingjia Huang , Shen Yan , Siyuan Zhou , Zhe Liu , Xiangtai Li , Shuangye Li , Wenqian Wang , Yi Lin , Hengshuang Zhao

Large Vision-Language Models (LVLMs) have achieved significant success in multimodal tasks, with multimodal chain-of-thought (MCoT) further enhancing performance and interpretability. Recent MCoT methods fall into two categories: (i)…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Zihui Cheng , Qiguang Chen , Xiao Xu , Jiaqi Wang , Weiyun Wang , Hao Fei , Yidong Wang , Alex Jinpeng Wang , Zhi Chen , Wanxiang Che , Libo Qin

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Vision-Language Pre-training (VLP) models like CLIP have achieved remarkable success in computer vision and particularly demonstrated superior robustness to distribution shifts of 2D images. However, their robustness under 3D viewpoint…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Shouwei Ruan , Yinpeng Dong , Hanqing Liu , Yao Huang , Hang Su , Xingxing Wei

In recent years, large-scale vision-language models (VLMs) have demonstrated remarkable performance on multimodal understanding and reasoning tasks. However, handling high-dimensional visual features often incurs substantial computational…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Xiaoyang Guo , Keze Wang

Engagement recognition in video datasets, unlike traditional image classification tasks, is particularly challenged by subjective labels and noise limiting model performance. To overcome the challenges of subjective and noisy engagement…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Alexander Vedernikov , Puneet Kumar , Haoyu Chen , Tapio Seppänen , Xiaobai Li

Real-World Image Super-Resolution is one of the most challenging task in image restoration. However, existing methods struggle with an accurate understanding of degraded image content, leading to reconstructed results that are both…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Junbo Qiao , Miaomiao Cai , Wei Li , Xudong Huang , Jie Hu , Xinghao Chen , Shaohui Lin , Hongkai Xiong

In this paper, we explore effective prompting techniques to enhance zero- and few-shot Visual Question Answering (VQA) performance in contemporary Vision-Language Models (VLMs). Central to our investigation is the role of question templates…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Rabiul Awal , Le Zhang , Aishwarya Agrawal

Recent studies have successfully integrated large vision-language models (VLMs) into low-level robotic control by supervised fine-tuning (SFT) with expert robotic datasets, resulting in what we term vision-language-action (VLA) models.…

机器人学 · 计算机科学 2025-01-29 Yanjiang Guo , Jianke Zhang , Xiaoyu Chen , Xiang Ji , Yen-Jen Wang , Yucheng Hu , Jianyu Chen

We introduce a novel self-improving framework that enhances Embodied Visual Tracking (EVT) with Vision-Language Models (VLMs) to address the limitations of current active visual tracking systems in recovering from tracking failure. Our…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Kui Wu , Shuhang Xu , Hao Chen , Churan Wang , Zhoujun Li , Yizhou Wang , Fangwei Zhong

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

While chain-of-thought (CoT) reasoning has substantially improved multimodal large language models (MLLMs) on complex reasoning tasks, existing approaches largely rely on long textual reasoning trajectories and provide limited mechanisms…

人工智能 · 计算机科学 2026-02-10 Siqu Ou , Tianrui Wan , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Vision-Language Models (VLMs) have achieved remarkable progress on a wide range of challenging multimodal understanding and reasoning tasks. However, existing reasoning paradigms, such as the classical Chain-of-Thought (CoT), rely solely on…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Yukun Qi , Pei Fu , Hang Li , Yuhan Liu , Chao Jiang , Bin Qin , Zhenbo Luo , Jian Luan

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Recent breakthroughs in reasoning language models have significantly advanced text-based reasoning. On the other hand, Multi-modal Large Language Models (MLLMs) still lag behind, hindered by their outdated internal LLMs. Upgrading these…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Xin Jin , Zhenguo Li , James T. Kwok , Yu Zhang