中文
相关论文

相关论文: ReaMOT: A Benchmark and Framework for Reasoning-ba…

200 篇论文

Tracking and segmentation play essential roles in video understanding, providing basic positional information and temporal association of objects within video sequences. Despite their shared objective, existing approaches often tackle these…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Tianlu Zhang , Qiang Zhang , Guiguang Ding , Jungong Han

Multimodal learning with incomplete modality is practical and challenging. Recently, researchers have focused on enhancing the robustness of pre-trained MultiModal Transformers (MMTs) under missing modality conditions by applying learnable…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Jian Lang , Zhangtao Cheng , Ting Zhong , Fan Zhou

Open-source multimodal large language models (MLLMs) have shown significant potential in a broad range of multimodal tasks. However, their reasoning capabilities remain constrained by existing instruction-tuning datasets, which were…

计算与语言 · 计算机科学 2025-06-05 Jarvis Guo , Tuney Zheng , Yuelin Bai , Bo Li , Yubo Wang , King Zhu , Yizhi Li , Graham Neubig , Wenhu Chen , Xiang Yue

Embodied AI is an inevitable trend that emphasizes the interaction between intelligent entities and the real world, with broad applications in Robotics, especially target-driven navigation. This task requires the robot to find an object of…

机器人学 · 计算机科学 2023-01-11 Junjia Liu , Jianfei Guo , Zehui Meng , Jingtao Xue

Spatial reasoning is a core aspect of human intelligence that allows perception, inference and planning in 3D environments. However, current vision-language models (VLMs) struggle to maintain geometric coherence and cross-view consistency…

人工智能 · 计算机科学 2025-12-03 Qiyao Xue , Weichen Liu , Shiqi Wang , Haoming Wang , Yuyang Wu , Wei Gao

The current remote sensing image analysis task is increasingly evolving from traditional object recognition to complex intelligence reasoning, which places higher requirements on the model's reasoning ability and the flexibility of tool…

人工智能 · 计算机科学 2025-12-04 Chujie Wang , Zhiyuan Luo , Ruiqi Liu , Can Ran , Shenghua Fan , Xi Chen , Chu He

Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution. Existing ALM systems trigger LLM thought processes while pulling…

计算与语言 · 计算机科学 2023-05-31 Binfeng Xu , Zhiyuan Peng , Bowen Lei , Subhabrata Mukherjee , Yuchen Liu , Dongkuan Xu

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

机器人学 · 计算机科学 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Large Reasoning Models (LRMs) leverage transparent reasoning traces, known as Chain-of-Thoughts (CoTs), to break down complex problems into intermediate steps and derive final answers. However, these reasoning traces introduce unique safety…

计算与语言 · 计算机科学 2025-10-16 Changyi Li , Jiayi Wang , Xudong Pan , Geng Hong , Min Yang

The rapid advancements in Vision-Language Models (VLMs) have shown great potential in tackling mathematical reasoning tasks that involve visual context. Unlike humans who can reliably apply solution steps to similar problems with minor…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Chengke Zou , Xingang Guo , Rui Yang , Junyu Zhang , Bin Hu , Huan Zhang

Large vision-language models (LVLMs) struggle to reliably detect visual primitives in charts and align them with semantic representations, which severely limits their performance on complex visual reasoning. This lack of perceptual…

人工智能 · 计算机科学 2026-03-13 Eunsoo Lee , Jeongwoo Lee , Minki Hong , Jangho Choi , Jihie Kim

Structured image understanding, such as interpreting tables and charts, requires strategically refocusing across various structures and texts within an image, forming a reasoning sequence to arrive at the final answer. However, current…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Xingyu Fu , Minqian Liu , Zhengyuan Yang , John Corring , Yijuan Lu , Jianwei Yang , Dan Roth , Dinei Florencio , Cha Zhang

Real-world reasoning often requires combining information across modalities, connecting textual context with visual cues in a multi-hop process. Yet, most multimodal benchmarks fail to capture this ability: they typically rely on single…

机器学习 · 计算机科学 2026-04-03 Junyoung Sung , Seungwoo Lyu , Minjun Kim , Sumin An , Arsha Nagrani , Paul Hongsuck Seo

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

We present ReMoT, a unified training paradigm to systematically address the fundamental shortcomings of VLMs in spatio-temporal consistency -- a critical failure point in navigation, robotics, and autonomous driving. ReMoT integrates two…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Cong Wan , Zeyu Guo , Jiangyang Li , SongLin Dong , Yifan Bai , Lin Peng , Zhiheng Ma , Yihong Gong

Multi-modal Chain-of-Thought (MCoT) requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning, which gains increasing attention. Nevertheless, the current MCoT benchmark still faces some…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Qiguang Chen , Libo Qin , Jin Zhang , Zhi Chen , Xiao Xu , Wanxiang Che

Mathematical reasoning in real-world video settings presents a fundamentally different challenge than in static images or text. It requires interpreting fine-grained visual information, accurately reading handwritten or digital text, and…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Hanoona Rasheed , Abdelrahman Shaker , Anqi Tang , Muhammad Maaz , Ming-Hsuan Yang , Salman Khan , Fahad Shahbaz Khan

A typical pipeline for multi-object tracking (MOT) is to use a detector for object localization, and following re-identification (re-ID) for object association. This pipeline is partially motivated by recent progress in both object…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Peize Sun , Jinkun Cao , Yi Jiang , Zehuan Yuan , Song Bai , Kris Kitani , Ping Luo

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao