中文
相关论文

相关论文: V-Zero: Self-Improving Multimodal Reasoning with Z…

200 篇论文

Large Vision-Language Models (LVLMs) have shown remarkable progress in various multimodal tasks, yet they often struggle with complex visual reasoning that requires multi-step inference. To address this limitation, we propose MF-SQ-LLaVA, a…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Liu Jing , Amirul Rahman

Vision generation remains a challenging frontier in artificial intelligence, requiring seamless integration of visual understanding and generative capabilities. In this paper, we propose a novel framework, Vision-Driven Prompt Optimization…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Leo Franklin , Apiradee Boonmee , Kritsada Wongsuwan

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

Humans learn to solve tasks of increasing complexity by building on top of previously acquired knowledge. Typically, there exists a natural progression in the tasks that we learn - most do not require completely independent solutions, but…

计算机视觉与模式识别 · 计算机科学 2018-10-01 Seung Wook Kim , Makarand Tapaswi , Sanja Fidler

This paper presents a novel approach to Single-Positive Multi-label Learning. In general multi-label learning, a model learns to predict multiple labels or categories for a single input image. This is in contrast with standard multi-class…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Xin Xing , Zhexiao Xiong , Abby Stylianou , Srikumar Sastry , Liyu Gong , Nathan Jacobs

Recent advances have shown that multimodal large language models (MLLMs) benefit from multimodal interleaved chain-of-thought (CoT) with vision tool interactions. However, existing open-source models often exhibit blind tool-use reasoning…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Chaoyang Wang , Kaituo Feng , Dongyang Chen , Zhongyu Wang , Zhixun Li , Sicheng Gao , Meng Meng , Xu Zhou , Manyuan Zhang , Yuzhang Shang , Xiangyu Yue

Recently, rapid advancements have been made in multimodal large language models (MLLMs), especially in video understanding tasks. However, current research focuses on simple video scenarios, failing to reflect the complex and diverse nature…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Lu Zhu , Tiantian Geng , Yangye Chen , Teng Wang , Ping Lu , Feng Zheng

Multimodal large language models (MLLMs) have shown promising capabilities in reasoning tasks, yet still struggle with complex problems requiring explicit self-reflection and self-correction, especially compared to their unimodal text-based…

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited by static perception…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Ziang Yan , Xinhao Li , Yinan He , Zhengrong Yue , Xiangyu Zeng , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Vision Language Models (VLMs) have demonstrated remarkable performance in open-world zero-shot visual recognition. However, their potential in space-related applications remains largely unexplored. In the space domain, accurate manual…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Samet Hicsonmez , Jose Sosa , Dan Pineau , Inder Pal Singh , Arunkumar Rathinam , Abd El Rahman Shabayek , Djamila Aouada

A key challenge in training Vision-Language Model (VLM) agents, compared to Language Model (LLM) agents, lies in the shift from textual states to complex visual observations. This transition introduces partial observability and demands…

We introduce Reward-Zero, a general-purpose implicit reward mechanism that transforms natural-language task descriptions into dense, semantically grounded progress signals for reinforcement learning (RL). Reward-Zero serves as a simple yet…

机器学习 · 计算机科学 2026-03-11 Heng Zhang , Haddy Alchaer , Arash Ajoudani , Yu She

Human-centric visual tasks have attracted increasing research attention due to their widespread applications. In this paper, we aim to learn a general human representation from massive unlabeled human images which can benefit downstream…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Weihua Chen , Xianzhe Xu , Jian Jia , Hao luo , Yaohua Wang , Fan Wang , Rong Jin , Xiuyu Sun

Vision-Language-Action (VLA) models are advancing autonomous driving by replacing modular pipelines with unified end-to-end architectures. However, current VLAs face two expensive requirements: (1) massive dataset collection, and (2) dense…

人工智能 · 计算机科学 2026-02-27 Ishaan Rawal , Shubh Gupta , Yihan Hu , Wei Zhan

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

人工智能 · 计算机科学 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

Large vision-language models (LVLMs) struggle to reliably detect visual primitives in charts and align them with semantic representations, which severely limits their performance on complex visual reasoning. This lack of perceptual…

人工智能 · 计算机科学 2026-03-13 Eunsoo Lee , Jeongwoo Lee , Minki Hong , Jangho Choi , Jihie Kim

Common self-improvement approaches for large language models (LLMs), such as STaR, iteratively fine-tune LLMs on self-generated solutions to improve their problem-solving ability. However, these approaches discard the large amounts of…

机器学习 · 计算机科学 2024-08-15 Arian Hosseini , Xingdi Yuan , Nikolay Malkin , Aaron Courville , Alessandro Sordoni , Rishabh Agarwal