中文
相关论文

相关论文: InternVL3.5: Advancing Open-Source Multimodal Mode…

200 篇论文

This paper aims to improve the performance of video multimodal large language models (MLLM) via long and rich context (LRC) modeling. As a result, we develop a new version of InternVideo2.5 with a focus on enhancing the original MLLMs'…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Yi Wang , Xinhao Li , Ziang Yan , Yinan He , Jiashuo Yu , Xiangyu Zeng , Chenting Wang , Changlian Ma , Haian Huang , Jianfei Gao , Min Dou , Kai Chen , Wenhai Wang , Yu Qiao , Yali Wang , Limin Wang

The deployment of Vision-Language Models (VLMs) in safety-critical domains like autonomous driving (AD) is critically hindered by reliability failures, most notably object hallucination. This failure stems from their reliance on ungrounded,…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Zhenguo Zhang , Haohan Zheng , Yishen Wang , Le Xu , Tianchen Deng , Xuefeng Chen , Qu Chen , Bo Zhang , Wuxiong Huang

Large Language Models (LLMs) have shown strong capabilities through two complementary paradigms: Retrieval-Augmented Generation (RAG) for knowledge grounding and Reinforcement Learning from Verifiable Rewards (RLVR) for complex reasoning.…

计算与语言 · 计算机科学 2026-04-27 Weitao Li , Boran Xiang , Xiaolong Wang , Zhinan Gou , Weizhi Ma , Yang Liu

We present PCL-Reasoner-V1.5, a 32-billion-parameter large language model (LLM) for mathematical reasoning. The model is built upon Qwen2.5-32B and refined via supervised fine-tuning (SFT) followed by reinforcement learning (RL). A central…

机器学习 · 计算机科学 2026-01-22 Yao Lu , Dengdong Fan , Jianzheng Nie , Fan Xu , Jie Chen , Bin Zhou , Yonghong Tian

Although Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, they encounter challenges in terms of reasoning efficiency, large model size and overthinking. However, existing lightweight…

人工智能 · 计算机科学 2025-11-21 Qixiang Yin , Huanjin Yao , Jianghao Chen , Jiaxing Huang , Zhicheng Zhao , Fei Su

Recent progress in large-scale reinforcement learning (RL) has notably enhanced the reasoning capabilities of large language models (LLMs), especially in mathematical domains. However, current multimodal LLMs (MLLMs) for mathematical…

计算与语言 · 计算机科学 2025-07-04 Wenhao Shi , Zhiqiang Hu , Yi Bin , Yang Yang , See-Kiong Ng , Heng Tao Shen

Despite rapid advancements, current text-to-image (T2I) models predominantly rely on a single-step generation paradigm, which struggles with complex semantics and faces diminishing returns from parameter scaling. While recent multi-step…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Hanbo Cheng , Limin Lin , Ruo Zhang , Yicheng Pan , Jun Du

Vision-Language Models in Continual Learning (VLM-CL) aim to continuously adapt to new multimodal tasks while retaining prior knowledge. The emerging paradigm that couples Multimodal Large Language Models (MLLMs) with Reinforcement Learning…

机器学习 · 计算机科学 2026-05-20 Qiuhe Hong , Yuyang Liu , Shuo Yang , Tiantian Peng , Fei Zhu , Yonghong Tian

Despite recent advancements in Multi-modal Large Language Models (MLLMs) on diverse understanding tasks, these models struggle to solve problems which require extensive multi-step reasoning. This is primarily due to the progressive dilution…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Byungwoo Jeon , Yoonwoo Jeong , Hyunseok Lee , Minsu Cho , Jinwoo Shin

Large Language Models have demonstrated remarkable reasoning capability in complex textual tasks. However, multimodal reasoning, which requires integrating visual and textual information, remains a significant challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Yi Yang , Xiaoxuan He , Hongkun Pan , Xiyan Jiang , Yan Deng , Xingtao Yang , Haoyu Lu , Dacheng Yin , Fengyun Rao , Minfeng Zhu , Bo Zhang , Wei Chen

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

计算与语言 · 计算机科学 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Multimodal large language models (MLLMs) have shown strong vision-language reasoning abilities but still lack robust 3D spatial understanding, which is critical for autonomous driving. This limitation stems from two key challenges: (1) the…

人工智能 · 计算机科学 2025-09-09 Ruixun Liu , Lingyu Kong , Derun Li , Hang Zhao

What does it take to build a visual reasoner that works across charts, science, spatial understanding, and open-ended tasks? The strongest vision-language models (VLMs) show such broad visual reasoning is within reach, but the recipe behind…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Gabriel Sarch , Linrong Cai , Qunzhong Wang , Haoyang Wu , Danqi Chen , Zhuang Liu

Recent advances in large multimodal models (LMMs) have enabled impressive reasoning and perception abilities, yet most existing training pipelines still depend on human-curated data or externally verified reward models, limiting their…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Omkar Thawakar , Shravan Venkatraman , Ritesh Thawkar , Abdelrahman Shaker , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Fahad Khan

In medical scenarios, effectively retrieving external knowledge and leveraging it for rigorous logical reasoning is of significant importance. Despite their potential, existing work has predominantly focused on enhancing either retrieval or…

计算与语言 · 计算机科学 2026-01-21 Keer Lu , Zheng Liang , Youquan Li , Jiejun Tan , Xili Wang , Da Pan , Shusen Zhang , Guosheng Dong , Bin Cui , Yunhuai Liu , Wentao Zhang

Large Language Models (LLMs) that can continually improve beyond their training budgets are able to solve increasingly difficult problems by adapting at test time, a property we refer to as extrapolation. However, standard reinforcement…

机器学习 · 计算机科学 2026-03-24 Ian Wu , Yuxiao Qu , Amrith Setlur , Aviral Kumar

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

计算与语言 · 计算机科学 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

Modern Vision-Language Models (VLMs) can solve a wide range of tasks requiring visual reasoning. In real-world scenarios, desirable properties for VLMs include fast inference and controllable generation (e.g., constraining outputs to adhere…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Shufan Li , Konstantinos Kallidromitis , Hritik Bansal , Akash Gokul , Yusuke Kato , Kazuki Kozuka , Jason Kuen , Zhe Lin , Kai-Wei Chang , Aditya Grover

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

机器学习 · 计算机科学 2026-04-14 Surendra Pathak , Bo Han

Reinforcement learning (RL) post-training has proven effective at unlocking reasoning, self-reflection, and tool-use capabilities in large language models. As models extend to omni-modal inputs and agentic multi-turn workflows, RL training…

计算与语言 · 计算机科学 2026-04-15 Liujie Zhang , Benzhe Ning , Rui Yang , Xiaoyan Yu , Jiaxing Li , Lumeng Wu , Jia Liu , Minghao Li , Weihang Chen , Weiqi Hu , Lei Zhang