中文
相关论文

相关论文: SketchVL: Policy Optimization via Fine-Grained Cre…

200 篇论文

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in visual understanding, they often struggle when faced with the unstructured and ambiguous nature of human-generated sketches. This limitation is particularly…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yuhang Su , Mei Wang , Yaoyao Zhong , Guozhang Li , Shixing Li , Yihan Feng , Hua Huang

Diffusion Multi-Modal Large Language Models (dMLLMs) are powerful for image generation, but optimizing them through reinforcement learning (RL) remains a major challenge. One primary difficulty is that a single image can be generated…

人工智能 · 计算机科学 2026-05-19 Siqi Luo , Jianghan Shen , Yi Xin , Huayu Zheng , Haoxing Chen , Yan Tai , Yue Li , Junjun He , Yihao Liu , Guangtao Zhai , Yuewen Cao , Xiaohong Liu

Visual reasoning is crucial for understanding complex multimodal data and advancing Artificial General Intelligence. Existing methods enhance the reasoning capability of Multimodal Large Language Models (MLLMs) through Reinforcement…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Chaoyang Wang , Zeyu Zhang , Meng Meng , Xu Zhou , Haiyun Jiang

Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks. However, these models predominantly rely on pure text as the medium for both…

机器学习 · 计算机科学 2026-02-23 Yi Xu , Chengzu Li , Han Zhou , Xingchen Wan , Caiqi Zhang , Anna Korhonen , Ivan Vulić

While Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Vision-Language Models (LVLMs), most existing methods in multimodal reasoning neglect the critical role of visual perception within…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Siyuan Huang , Xiaoye Qu , Yafu Li , Yun Luo , Zefeng He , Daizong Liu , Yu Cheng

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet how visual evidence is integrated during reasoning remains poorly understood. We…

人工智能 · 计算机科学 2026-02-13 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu

Enhancing the reasoning capabilities of large language models effectively using reinforcement learning (RL) remains a crucial challenge. Existing approaches primarily adopt two contrasting advantage estimation granularities: token-level…

机器学习 · 计算机科学 2025-10-22 Yiran Guo , Lijie Xu , Jie Liu , Dan Ye , Shuang Qiu

Visual reasoning, a cornerstone of human intelligence, encompasses complex perceptual and logical processes essential for solving diverse visual problems. While advances in computer vision have produced powerful models for various…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Zetong Zhou , Dongping Chen , Zixian Ma , Zhihan Hu , Mingyang Fu , Sinan Wang , Yao Wan , Zhou Zhao , Ranjay Krishna

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Charts are essential to data analysis, transforming raw data into clear visual representations that support human decision-making. Although current vision-language models (VLMs) have made significant progress, they continue to struggle with…

While Multimodal Large Language Models (MLLMs) excel at visual understanding, they often struggle in complex scenarios that require visual planning and imagination. Inspired by how humans use sketching as a form of visual thinking to…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Huanyu Zhang , Wenshan Wu , Chengzu Li , Ning Shang , Yan Xia , Yangyu Huang , Yifan Zhang , Li Dong , Zhang Zhang , Liang Wang , Tieniu Tan , Furu Wei

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

机器学习 · 计算机科学 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

With the rapid progress of Multimodal Large Language Models (MLLMs), unified MLLMs that jointly perform image understanding and generation have advanced significantly. However, despite the inherent reasoning capabilities of unified MLLMs…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yongjin Kim , Yoonjin Oh , Yerin Kim , Hyomin Kim , Jeeyoung Yun , Yujung Heo , Minjun Kim , Sungwoong Kim

Large language models (LLMs) have shown promise in generating program workflows for visual tasks. However, previous approaches often rely on closed-source models, lack systematic reasoning, and struggle with long-form video question…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Chenglin Li , Feng Han , Yikun Wang , Ruilin Li , Shuai Dong , Haowen Hou , Haitao Li , Qianglong Chen , Feng Tao , Jingqi Tong , Yin Zhang , Jiaqi Wang

Large reasoning models (LRMs) are commonly trained with reinforcement learning (RL) to explore long chain-of-thought reasoning, achieving strong performance at high computational cost. Recent methods add multi-reward objectives to jointly…

人工智能 · 计算机科学 2026-02-17 Anhao Zhao , Ziyang Chen , Junlong Tong , Yingqi Fan , Fanghua Ye , Shuhao Li , Yunpu Ma , Wenjie Li , Xiaoyu Shen

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved 2D visual understanding, prompting interest in their application to complex 3D reasoning tasks. However, it remains unclear whether these models can…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Xiaoyu Zhan , Wenxuan Huang , Hao Sun , Xinyu Fu , Changfeng Ma , Shaosheng Cao , Bohan Jia , Shaohui Lin , Zhenfei Yin , Lei Bai , Wanli Ouyang , Yuanqi Li , Jie Guo , Yanwen Guo

While vision-language models (VLMs) have exhibited multi-turn visual reasoning capabilities, their reasoning trajectories remain relatively shallow and are dominated by a text-centric paradigm, limiting their applicability to complex visual…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Zhiwei Ning , Wenwen Tong , Xiangli Kong , Shengnan Ma , Ziyi Shang , Jingcheng Ni , Tao Hu , Yong Xien Chng , Jixuan Ying , Zehuan Wu , Hanming Deng , Jie Yang , Yuanjie Zheng , Wei Liu , Lewei Lu

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated strong semantic understanding capabilities, but struggles to perform precise spatio-temporal understanding. Existing spatio-temporal methods primarily focus on the…