中文
相关论文

相关论文: SATORI-R1: Incentivizing Multimodal Reasoning thro…

200 篇论文

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Large Language Models have demonstrated remarkable reasoning capability in complex textual tasks. However, multimodal reasoning, which requires integrating visual and textual information, remains a significant challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Yi Yang , Xiaoxuan He , Hongkun Pan , Xiyan Jiang , Yan Deng , Xingtao Yang , Haoyu Lu , Dacheng Yin , Fengyun Rao , Minfeng Zhu , Bo Zhang , Wei Chen

Leveraging multimodal large models for image segmentation has become a prominent research direction. However, existing approaches typically rely heavily on manually annotated datasets that include explicit reasoning processes, which are…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiaqi Huang , Zunnan Xu , Jun Zhou , Ting Liu , Yicheng Xiao , Mingwen Ou , Bowen Ji , Xiu Li , Kehong Yuan

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Video reasoning requires models to locate and track question-relevant evidence across frames. While reinforcement learning (RL) with verifiable rewards improves accuracy, it still struggles to achieve reliable spatio-temporal grounding…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Daeun Lee , Shoubin Yu , Yue Zhang , Mohit Bansal

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

We present ChatR1, a reasoning framework based on reinforcement learning (RL) for conversational question answering (CQA). Reasoning plays an important role in CQA, where user intent evolves across dialogue turns, and utterances are often…

计算与语言 · 计算机科学 2026-04-28 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Vision-language models (VLMs) have shown impressive capabilities across diverse tasks, motivating efforts to leverage these models to supervise robot learning. However, when used as evaluators in reinforcement learning (RL), today's…

机器人学 · 计算机科学 2026-05-27 Philip Schroeder , Thomas Weng , Karl Schmeckpeper , Eric Rosen , Stephen Hart , Ondrej Biza

Large language models (LLMs) have demonstrated remarkable reasoning capabilities across diverse domains. Recent studies have shown that increasing test-time computation enhances LLMs' reasoning capabilities. This typically involves…

计算与语言 · 计算机科学 2025-06-17 Maohao Shen , Guangtao Zeng , Zhenting Qi , Zhang-Wei Hong , Zhenfang Chen , Wei Lu , Gregory Wornell , Subhro Das , David Cox , Chuang Gan

When thinking with images, humans rarely rely on a single glance: they revisit visual evidence while reasoning. In contrast, most Multimodal Language Models encode an image once to key-value cache and then reason purely in text, making it…

计算与语言 · 计算机科学 2026-05-08 Jiwan Chung , Junhyeok Kim , Siyeol Kim , Jaeyoung Lee , Min Soo Kim , Youngjae Yu

The recent explosive interest in the reasoning capabilities of large language models, such as DeepSeek-R1, has demonstrated remarkable success through reinforcement learning-based fine-tuning frameworks, exemplified by methods like Group…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Chenbin Pan , Wenbin He , Zhengzhong Tu , Liu Ren

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Multimodal Object-Entity Relation Extraction (MORE) is a challenging task in information extraction research. It aims to identify relations between visual objects and textual entities, requiring complex multimodal understanding and…

多媒体 · 计算机科学 2026-03-11 Xiang Yuan , Xu Chu , Xinrong Chen , Haochen Li , Zonghong Dai , Hongcheng Fan , Xiaoyue Yuan , Weiping Li , Tong Mo

Large Vision-Language Models (LVLMs) have recently shown great promise in advancing robotics by combining embodied reasoning with robot control. A common approach involves training on embodied reasoning tasks related to robot control using…

机器人学 · 计算机科学 2026-01-19 Dongyoung Kim , Sumin Park , Huiwon Jang , Jinwoo Shin , Jaehyung Kim , Younggyo Seo

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

While chain-of-thought (CoT) reasoning has substantially improved multimodal large language models (MLLMs) on complex reasoning tasks, existing approaches largely rely on long textual reasoning trajectories and provide limited mechanisms…

人工智能 · 计算机科学 2026-02-10 Siqu Ou , Tianrui Wan , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

Long-horizon video-audio reasoning and fine-grained pixel understanding impose conflicting requirements on omnimodal models: dense temporal coverage demands many low-resolution frames, whereas precise grounding calls for high-resolution…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Hao Zhong , Muzhi Zhu , Zongze Du , Zheng Huang , Canyu Zhao , Mingyu Liu , Wen Wang , Hao Chen , Chunhua Shen

We introduce Skywork R1V, a multimodal reasoning model extending the an R1-series Large language models (LLM) to visual modalities via an efficient multimodal transfer method. Leveraging a lightweight visual projector, Skywork R1V…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yi Peng , Peiyu Wang , Xiaokun Wang , Yichen Wei , Jiangbo Pei , Weijie Qiu , Ai Jian , Yunzhuo Hao , Jiachun Pan , Tianyidan Xie , Li Ge , Rongxian Zhuang , Xuchen Song , Yang Liu , Yahui Zhou