中文
相关论文

相关论文: Does Seeing More Mean Knowing More? Mono-Anchored …

200 篇论文

Multi-modal machine translation aims at translating the source sentence into a different language in the presence of the paired image. Previous work suggests that additional visual information only provides dispensable help to translation,…

计算与语言 · 计算机科学 2019-12-30 Pengcheng Yang , Boxing Chen , Pei Zhang , Xu Sun

While reinforcement learning has advanced the reasoning abilities of Large Language Models (LLMs), these gains are largely confined to English, creating a significant performance disparity across languages. To address this, we introduce…

计算与语言 · 计算机科学 2025-10-01 Fahim Faisal , Kaiqiang Song , Song Wang , Simin Ma , Shujian Liu , Haoyun Deng , Sathish Reddy Indurthi

Recent advances in reinforcement learning (RL) have significantly improved the complex reasoning capabilities of large language models (LLMs). Despite these successes, existing methods mainly focus on single-domain RL (e.g., mathematics)…

人工智能 · 计算机科学 2025-11-20 Baolong Bi , Shenghua Liu , Yiwei Wang , Siqian Tong , Lingrui Mei , Yuyao Ge , Yilong Xu , Jiafeng Guo , Xueqi Cheng

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic deep search. However, its application is often hindered by low \textbf{Reward Density} in deep search scenarios, where agents expend…

计算与语言 · 计算机科学 2025-10-31 Kun Luo , Hongjin Qian , Zheng Liu , Ziyi Xia , Shitao Xiao , Siqi Bao , Jun Zhao , Kang Liu

Large Reasoning Models (LRMs) with long chain-of-thought capabilities, optimized via reinforcement learning with verifiable rewards (RLVR), excel at objective reasoning tasks like mathematical problem solving and code generation. However,…

计算与语言 · 计算机科学 2026-03-03 Yumeng Wang , Zhiyuan Fan , Jiayu Liu , Jen-tse Huang , Yi R. Fung

Cross-Modal Retrieval (CMR), which retrieves relevant items from one modality (e.g., audio) given a query in another modality (e.g., visual), has undergone significant advancements in recent years. This capability is crucial for robots to…

机器人学 · 计算机科学 2024-07-31 Jagoda Wojcik , Jiaqi Jiang , Jiacheng Wu , Shan Luo

This report presents MARS, short for Multimodal Agentic Reasoning with Source selection, our system for the CASTLE Challenge at EgoVis 2026. Participants must answer 185 closed-form questions over the CASTLE 2024 dataset. In contrast to…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Haoyu Zhang , Qiaohui Chu , Yisen Feng , Meng Liu , Weili Guan , Yaowei Wang , Liqiang Nie

Recent advances in reasoning models have shown remarkable progress in text-based domains, but transferring those capabilities to multimodal settings, e.g., to allow reasoning over audio-visual data, still remains a challenge, in part…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Edson Araujo , Saurabhchand Bhati , M. Jehanzeb Mirza , Brian Kingsbury , Samuel Thomas , Rogerio Feris , James R. Glass , Hilde Kuehne

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

While humans perceive the world through diverse modalities that operate synergistically to support a holistic understanding of their surroundings, existing omnivideo models still face substantial challenges on audio-visual understanding…

Reinforcement Learning with Verifiable Rewards (RLVR) improves LLM reasoning, yet growing evidence indicates an exploration ceiling: it often reweights existing solution traces rather than discovering new strategies, limiting gains under…

机器学习 · 计算机科学 2026-03-03 Bizhe Bai , Xinyue Wang , Peng Ye , Tao Chen

Achieving artificial visual reasoning - the ability to answer image-related questions which require a multi-step, high-level process - is an important step towards artificial general intelligence. This multi-modal task requires learning a…

计算机视觉与模式识别 · 计算机科学 2017-12-20 Ethan Perez , Harm de Vries , Florian Strub , Vincent Dumoulin , Aaron Courville

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

计算与语言 · 计算机科学 2026-05-29 Redacted by arXiv

Reinforcement learning (RL) has emerged as a critical technique for enhancing LLM-based deep search agents. However, existing approaches primarily rely on binary outcome rewards, which fail to capture the comprehensiveness and factuality of…

计算与语言 · 计算机科学 2026-01-12 Jiajie Zhang , Xin Lv , Ling Feng , Lei Hou , Juanzi Li

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Open-source multimodal large language models (MLLMs) excel in various tasks involving textual and visual inputs but still struggle with complex multimodal mathematical reasoning, lagging behind proprietary models like GPT-4V(ision) and…

计算与语言 · 计算机科学 2024-04-29 Mengzhao Jia , Zhihan Zhang , Wenhao Yu , Fangkai Jiao , Meng Jiang

Fine-grained visual reasoning remains a core challenge for multimodal large language models (MLLMs). The recently introduced ReasonMap highlights this gap by showing that even advanced MLLMs struggle with spatial reasoning in structured and…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Sicheng Feng , Kaiwen Tuo , Song Wang , Lingdong Kong , Jianke Zhu , Huan Wang

Retrieval-augmented systems are typically evaluated in settings where information required to answer the query can be found within a single source or the answer is short-form or factoid-based. However, many real-world applications demand…

计算与语言 · 计算机科学 2025-08-29 Rohan Phanse , Yijie Zhou , Kejian Shi , Wencai Zhang , Yixin Liu , Yilun Zhao , Arman Cohan

Zero-shot visual question answering (VQA) is a challenging task that requires reasoning across modalities. While some existing methods rely on a single rationale within the Chain of Thoughts (CoT) framework, they may fall short of capturing…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Tao Li , Linjun Shou , Xuejun Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capability of large language models (LLMs), enabling autonomous agents that can conduct effective multi-turn and tool-integrated reasoning. While instructions…

机器学习 · 计算机科学 2026-02-03 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen