中文
相关论文

相关论文: Generalizable Geometric Image Caption Synthesis

200 篇论文

The creation of high-quality human-labeled image-caption datasets presents a significant bottleneck in the development of Visual-Language Models (VLMs). In this work, we investigate an approach that leverages the strengths of Large Language…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Sahand Sharifzadeh , Christos Kaplanis , Shreya Pathak , Dharshan Kumaran , Anastasija Ilic , Jovana Mitrovic , Charles Blundell , Andrea Banino

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

计算与语言 · 计算机科学 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for post-training large language models (LLMs) on complex reasoning tasks. Yet, the conditions under which RLVR yields robust generalization remain…

机器学习 · 计算机科学 2026-03-05 Brian Lu , Hongyu Zhao , Shuo Sun , Hao Peng , Rui Ding , Hongyuan Mei

Synthetic data is crucial for advancing autonomous driving (AD) systems, yet current state-of-the-art video generation models, despite their visual realism, suffer from subtle geometric distortions that limit their utility for downstream…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Tianyi Yan , Wencheng Han , Xia Zhou , Xueyang Zhang , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Reinforcement Learning with Verifiable Rewards (RLVR) has been successfully applied to significantly boost the capabilities of pretrained large language models, especially in the math and logic problem domains. However, current research and…

计算与语言 · 计算机科学 2026-03-16 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

Recent advances in large language and vision-language models have enabled strong reasoning capabilities, yet they remain impractical for specialized domains like remote sensing, where annotated data is scarce and expensive. We present the…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Aybora Koksal , A. Aydin Alatan

Vision-language models (VLMs) often struggle to generate accurate and detailed captions for high-resolution images since they are typically pre-trained on low-resolution inputs (e.g., 224x224 or 336x336 pixels). Downscaling high-resolution…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Hankyeol Lee , Gawon Seo , Kyounggyu Lee , Dogun Kim , Kyungwoo Song , Jiyoung Jung

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

机器学习 · 计算机科学 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Despite their proficiency in general tasks, Multi-modal Large Language Models (MLLMs) struggle with automatic Geometry Problem Solving (GPS), which demands understanding diagrams, interpreting symbols, and performing complex reasoning. This…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Renqiu Xia , Mingsheng Li , Hancheng Ye , Wenjie Wu , Hongbin Zhou , Jiakang Yuan , Tianshuo Peng , Xinyu Cai , Xiangchao Yan , Bin Wang , Conghui He , Botian Shi , Tao Chen , Junchi Yan , Bo Zhang

This paper presents GPSM4K, a comprehensive geometry multimodal dataset tailored to augment the problem-solving capabilities of Large Vision Language Models (LVLMs). GPSM4K encompasses 2157 multimodal question-answer pairs manually…

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Self-consistency methods are the core technique for improving the reasoning reliability of multimodal large language models (MLLMs). By generating multiple reasoning results through repeated sampling and selecting the best answer via…

计算与语言 · 计算机科学 2026-02-05 Xinglong Yang , Zhilin Peng , Zhanzhan Liu , Haochen Shi , Sheng-Jun Huang

While recent advances in reinforcement learning have significantly enhanced reasoning capabilities in large language models (LLMs), these techniques remain underexplored in multi-modal LLMs for video captioning. This paper presents the…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Desen Meng , Rui Huang , Zhilin Dai , Xinhao Li , Yifan Xu , Jun Zhang , Zhenpeng Huang , Meng Zhang , Lingshu Zhang , Yi Liu , Limin Wang

Recent multi-view multimedia applications struggle between high-resolution (HR) visual experience and storage or bandwidth constraints. Therefore, this paper proposes a Multi-View Image Super-Resolution (MVISR) task. It aims to increase the…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Ri Cheng , Yuqi Sun , Bo Yan , Weimin Tan , Chenxi Ma

Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models. However,…

机器学习 · 计算机科学 2025-10-28 Hoang Phan , Xianjun Yang , Kevin Yao , Jingyu Zhang , Shengjie Bi , Xiaocheng Tang , Madian Khabsa , Lijuan Liu , Deren Lei

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer from poor visual and temporal grounding: a model may fabricate object existence, assign…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Yihao Quan , Zeru Shi , Jinman Zhao , Ruixiang Tang

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Accurate chart comprehension represents a critical challenge in advancing multimodal learning systems, as extensive information is compressed into structured visual representations. However, existing vision-language models (VLMs) frequently…

机器学习 · 计算机科学 2026-03-10 Xin Zhang , Xingyu Li , Rongguang Wang , Ruizhong Miao , Zheng Wang , Dan Roth , Chenyang Li

Multimodal Large Language Models (MLLMs) have achieved notable gains in various tasks by incorporating Chain-of-Thought (CoT) reasoning in language spaces. Recent work extends this direction by leveraging external tools for visual editing,…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Bangzheng Li , Ximeng Sun , Jiang Liu , Ze Wang , Jialian Wu , Xiaodong Yu , Hao Chen , Emad Barsoum , Muhao Chen , Zicheng Liu