English
Related papers

Related papers: V-Zero: Self-Improving Multimodal Reasoning with Z…

200 papers

Large Vision-Language Models (LVLMs) have shown remarkable progress in various multimodal tasks, yet they often struggle with complex visual reasoning that requires multi-step inference. To address this limitation, we propose MF-SQ-LLaVA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Liu Jing , Amirul Rahman

Vision generation remains a challenging frontier in artificial intelligence, requiring seamless integration of visual understanding and generative capabilities. In this paper, we propose a novel framework, Vision-Driven Prompt Optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Leo Franklin , Apiradee Boonmee , Kritsada Wongsuwan

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

Humans learn to solve tasks of increasing complexity by building on top of previously acquired knowledge. Typically, there exists a natural progression in the tasks that we learn - most do not require completely independent solutions, but…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Seung Wook Kim , Makarand Tapaswi , Sanja Fidler

This paper presents a novel approach to Single-Positive Multi-label Learning. In general multi-label learning, a model learns to predict multiple labels or categories for a single input image. This is in contrast with standard multi-class…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xin Xing , Zhexiao Xiong , Abby Stylianou , Srikumar Sastry , Liyu Gong , Nathan Jacobs

Recent advances have shown that multimodal large language models (MLLMs) benefit from multimodal interleaved chain-of-thought (CoT) with vision tool interactions. However, existing open-source models often exhibit blind tool-use reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Chaoyang Wang , Kaituo Feng , Dongyang Chen , Zhongyu Wang , Zhixun Li , Sicheng Gao , Meng Meng , Xu Zhou , Manyuan Zhang , Yuzhang Shang , Xiangyu Yue

Recently, rapid advancements have been made in multimodal large language models (MLLMs), especially in video understanding tasks. However, current research focuses on simple video scenarios, failing to reflect the complex and diverse nature…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Lu Zhu , Tiantian Geng , Yangye Chen , Teng Wang , Ping Lu , Feng Zheng

Multimodal large language models (MLLMs) have shown promising capabilities in reasoning tasks, yet still struggle with complex problems requiring explicit self-reflection and self-correction, especially compared to their unimodal text-based…

Computation and Language · Computer Science 2025-10-07 Zhongwei Wan , Zhihao Dou , Che Liu , Yu Zhang , Dongfei Cui , Qinjian Zhao , Hui Shen , Jing Xiong , Yi Xin , Yifan Jiang , Chaofan Tao , Yangfan He , Mi Zhang , Shen Yan

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited by static perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ziang Yan , Xinhao Li , Yinan He , Zhengrong Yue , Xiangyu Zeng , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang

Vision Language Models (VLMs) have demonstrated remarkable performance in open-world zero-shot visual recognition. However, their potential in space-related applications remains largely unexplored. In the space domain, accurate manual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Samet Hicsonmez , Jose Sosa , Dan Pineau , Inder Pal Singh , Arunkumar Rathinam , Abd El Rahman Shabayek , Djamila Aouada

A key challenge in training Vision-Language Model (VLM) agents, compared to Language Model (LLM) agents, lies in the shift from textual states to complex visual observations. This transition introduces partial observability and demands…

We introduce Reward-Zero, a general-purpose implicit reward mechanism that transforms natural-language task descriptions into dense, semantically grounded progress signals for reinforcement learning (RL). Reward-Zero serves as a simple yet…

Machine Learning · Computer Science 2026-03-11 Heng Zhang , Haddy Alchaer , Arash Ajoudani , Yu She

Human-centric visual tasks have attracted increasing research attention due to their widespread applications. In this paper, we aim to learn a general human representation from massive unlabeled human images which can benefit downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Weihua Chen , Xianzhe Xu , Jian Jia , Hao luo , Yaohua Wang , Fan Wang , Rong Jin , Xiuyu Sun

Vision-Language-Action (VLA) models are advancing autonomous driving by replacing modular pipelines with unified end-to-end architectures. However, current VLAs face two expensive requirements: (1) massive dataset collection, and (2) dense…

Artificial Intelligence · Computer Science 2026-02-27 Ishaan Rawal , Shubh Gupta , Yihan Hu , Wei Zhan

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

Large vision-language models (LVLMs) struggle to reliably detect visual primitives in charts and align them with semantic representations, which severely limits their performance on complex visual reasoning. This lack of perceptual…

Artificial Intelligence · Computer Science 2026-03-13 Eunsoo Lee , Jeongwoo Lee , Minki Hong , Jangho Choi , Jihie Kim

Common self-improvement approaches for large language models (LLMs), such as STaR, iteratively fine-tune LLMs on self-generated solutions to improve their problem-solving ability. However, these approaches discard the large amounts of…

Machine Learning · Computer Science 2024-08-15 Arian Hosseini , Xingdi Yuan , Nikolay Malkin , Aaron Courville , Alessandro Sordoni , Rishabh Agarwal