English
Related papers

Related papers: Spec-o3: A Tool-Augmented Vision-Language Agent fo…

200 papers

The ability for AI agents to "think with images" requires a sophisticated blend of reasoning and perception. However, current open multimodal agents still largely fall short on the reasoning aspect crucial for real-world tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaican Li , Lewei Yao , Jiannan Wu , Tiezheng Yu , Jierun Chen , Haoli Bai , Lu Hou , Lanqing Hong , Wei Zhang , Nevin L. Zhang

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei

With the growing demand for oriented object detection (OOD), recent studies on point-supervised OOD have attracted significant interest. In this paper, we propose PointOBB-v3, a stronger single point-supervised OOD framework. Compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Peiyuan Zhang , Junwei Luo , Xue Yang , Yi Yu , Qingyun Li , Yue Zhou , Xiaosong Jia , Xudong Lu , Jingdong Chen , Xiang Li , Junchi Yan , Yansheng Li

Vision-language model (VLM) fine-tuning for application-specific visual grounding based on natural language instructions has become one of the most popular approaches for learning-enabled autonomous systems. However, such fine-tuning relies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Joshua R. Waite , Md. Zahid Hasan , Qisai Liu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

Active vision, also known as active perception, refers to the process of actively selecting where and how to look in order to gather task-relevant information. It is a critical component of efficient perception and decision-making in humans…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Muzhi Zhu , Hao Zhong , Canyu Zhao , Zongze Du , Zheng Huang , Mingyu Liu , Hao Chen , Cheng Zou , Jingdong Chen , Ming Yang , Chunhua Shen

Agentic multimodal large language models (MLLMs) (e.g., OpenAI o3 and Gemini Agentic Vision) achieve remarkable reasoning capabilities through iterative visual tool invocation. However, the cascaded perception, reasoning, and tool-calling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Haoyu Huang , Jinfa Huang , Zhongwei Wan , Xiawu Zheng , Rongrong Ji , Jiebo Luo

Large Reasoning Models (LRMs) like o3 and DeepSeek-R1 have achieved remarkable progress in reasoning tasks with long cot. However, they remain computationally inefficient and struggle with accuracy when solving problems requiring complex…

Artificial Intelligence · Computer Science 2026-03-03 Haipeng Luo , Huawen Feng , Qingfeng Sun , Can Xu , Kai Zheng , Yufei Wang , Tao Yang , Han Hu , Yansong Tang

Vision-Language Models (VLMs) enable powerful multimodal reasoning but suffer from slow autoregressive inference, limiting their deployment in real-time applications. We introduce Spec-LLaVA, a system that applies speculative decoding to…

Computation and Language · Computer Science 2025-09-16 Mingxiao Huo , Jiayi Zhang , Hewei Wang , Jinfeng Xu , Zheyu Chen , Huilin Tai , Yijun Chen

Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Current reasoning paradigms rely on either sequential step-by-step generation or parallel…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhicheng Zhang , Wentao Gu , Weicheng Wang , Yongjie Zhu , Wenyu Qin , Meng Wang , Pengfei Wan , Jufeng Yang

The proper scientific analysis of a large amount of stellar spectra requires certain capabilities of the analysing tool (e.g. precise semi-automatic fitting for normalisation of the continuum or line-list assisted measurement of spectral…

Instrumentation and Methods for Astrophysics · Physics 2011-12-14 Petr Škoda

Existing multimodal large language models for long-video understanding predominantly rely on uniform sampling and single-turn inference, limiting their ability to identify sparse yet critical evidence amid extensive redundancy. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiangyu Zeng , Zhiqiu Zhang , Yuhan Zhu , Xinhao Li , Zikang Wang , Changlian Ma , Qingyu Zhang , Zizheng Huang , Kun Ouyang , Tianxiang Jiang , Ziang Yan , Yi Wang , Hongjie Zhang , Yali Wang , Limin Wang

Current Vision-Language Models (VLMs) struggle with fine-grained spatial reasoning, particularly when multi-step logic and precise spatial alignment are required. In this work, we introduce SpatialReasoner-R1, a vision-language reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yifan Shen , Yuanzhe Liu , Jingyuan Zhu , Xu Cao , Xiaofeng Zhang , Yixiao He , Wenming Ye , James Matthew Rehg , Ismini Lourentzou

3D visual grounding involves finding a target object in a 3D scene that corresponds to a given sentence query. Although many approaches have been proposed and achieved impressive performance, they all require dense object-sentence pair…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Zehan Wang , Haifeng Huang , Yang Zhao , Linjun Li , Xize Cheng , Yichen Zhu , Aoxiong Yin , Zhou Zhao

The growing need for autonomous on-orbit services such as inspection, maintenance, and situational awareness calls for intelligent spacecraft capable of complex maneuvers around large orbital targets. Traditional control systems often fall…

Robotics · Computer Science 2025-10-28 Matteo El-Hariry , Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez

Open-Vocabulary Object Detection (OVOD) aims to enable detectors to generalize across categories by leveraging semantic information. Although existing methods are pretrained on large vision-language datasets, their inference is still…

Artificial Intelligence · Computer Science 2026-04-21 Chujie Wang , Jianyu Lu , Zhiyuan Luo , Xi Chen , Chu He

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of text-defined categories, demanding reliable generalization to unseen classes at inference. Although modern vision-language models (VLMs) support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Saikat Dutta , Biplab Banerjee , Hamid Rezatofighi

Small Vision-Language Models (SVLMs) are efficient task controllers but often suffer from visual brittleness and poor tool orchestration. They typically require expensive supervised trajectory tuning to mitigate these deficits. In this…

Artificial Intelligence · Computer Science 2026-04-21 Ashutosh Bajpai , Tamal Majumder , Akshay Nambi , Tanmoy Chakraborty

Vision language models (VLM) have demonstrated remarkable performance across various downstream tasks. However, understanding fine-grained visual-linguistic concepts, such as attributes and inter-object relationships, remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wujian Peng , Sicheng Xie , Zuyao You , Shiyi Lan , Zuxuan Wu

Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and…

‹ Prev 1 2 3 10 Next ›