English
Related papers

Related papers: Video-Browser: Towards Agentic Open-web Video Brow…

200 papers

Visual perception connects high-level semantic understanding to pixel-level perception, but most existing settings assume that the decisive evidence for identifying a target is already in the image or frozen model knowledge. We study a more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Bokang Yang , Xinyi Sun , Kaituo Feng , Xingping Dong , Dongming Wu , Xiangyu Yue

Computer-use agents can operate computers and automate laborious tasks, but despite recent rapid progress, they still lag behind human users, especially when tasks require domain-specific procedural knowledge about particular applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yujian Liu , Ze Wang , Hao Chen , Ximeng Sun , Xiaodong Yu , Jialian Wu , Jiang Liu , Emad Barsoum , Zicheng Liu , Shiyu Chang

Long-form video understanding remains challenging for Vision-Language Models (VLMs) due to the inherent tension between computational constraints and the need to capture information distributed across thousands of frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Junbo Zou , Ziheng Huang , Shengjie Zhang , Liwen Zhang , Weining Shen

Addressing intricate real-world problems necessitates in-depth information seeking and multi-step reasoning. Recent progress in agentic systems, exemplified by Deep Research, underscores the potential for autonomous multi-step research. In…

Computation and Language · Computer Science 2025-08-12 Jialong Wu , Baixuan Li , Runnan Fang , Wenbiao Yin , Liwen Zhang , Zhengwei Tao , Dingchu Zhang , Zekun Xi , Gang Fu , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

The inherent complexity of video understanding makes it difficult to attribute whether performance gains stem from visual perception, linguistic reasoning, or knowledge priors. While many benchmarks have emerged to assess high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Geuntaek Lim , Minho Shim , Sungjune Park , Jaeyun Lee , Inwoong Lee , Taeoh Kim , Dongyoon Wee , Yukyung Choi

Recent advancements in Large Language Models (LLMs) have expanded their capabilities to multimodal contexts, including comprehensive video understanding. However, processing extensive videos such as 24-hour CCTV footage or full-length films…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Lu Zhang , Tiancheng Zhao , Heting Ying , Yibo Ma , Kyusong Lee

The exponential rise in mobile device usage necessitates streamlined automation for effective task management, yet many AI frameworks fall short due to inadequate operational expertise. While manually written knowledge can bridge this gap,…

Artificial Intelligence · Computer Science 2025-06-04 Junyang Wang , Haiyang Xu , Xi Zhang , Ming Yan , Ji Zhang , Fei Huang , Jitao Sang

The exponential rise in mobile device usage necessitates streamlined automation for effective task management, yet many AI frameworks fall short due to inadequate operational expertise. While manually written knowledge can bridge this gap,…

Computation and Language · Computer Science 2025-06-04 Junyang Wang , Haiyang Xu , Xi Zhang , Ming Yan , Ji Zhang , Fei Huang , Jitao Sang

Video question answering (VideoQA) enables machines to extract and comprehend key information from videos through natural language interaction, which is a critical step towards achieving intelligence. However, the demand for a thorough…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sunqi Fan , Meng-Hao Guo , Shuojin Yang

Despite seemingly performant web agents on the task-completion benchmarks, most existing methods evaluate the agents based on a presupposition: the web navigation task consists of linear sequence of actions with an end state that marks task…

Artificial Intelligence · Computer Science 2024-10-28 Revanth Gangi Reddy , Sagnik Mukherjee , Jeonghwan Kim , Zhenhailong Wang , Dilek Hakkani-Tur , Heng Ji

We present BrowseComp, a simple yet challenging benchmark for measuring the ability for agents to browse the web. BrowseComp comprises 1,266 questions that require persistently navigating the internet in search of hard-to-find, entangled…

Agentic search such as Deep Research systems-where agents autonomously browse the web, synthesize information, and return comprehensive citation-backed answers-represents a major shift in how users interact with web-scale information. While…

Multimodal large language models (MLLMs), equipped with increasingly advanced planning and tool-use capabilities, are evolving into autonomous agents capable of performing multimodal web browsing and deep search in open-world environments.…

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Online video understanding requires models to perform continuous perception and long-range reasoning within potentially infinite visual streams. Its fundamental challenge lies in the conflict between the unbounded nature of streaming media…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Siwei Wen , Zhangcheng Wang , Xingjian Zhang , Lei Huang , Wenjun Wu

Efficiently solving real-world problems with LLMs increasingly hinges on their ability to interact with dynamic web environments and autonomously acquire external information. While recent research like Search-R1 and WebDancer demonstrates…

Computation and Language · Computer Science 2025-10-15 Tao Yu , Zhengbo Zhang , Zhiheng Lyu , Junhao Gong , Hongzhu Yi , Xinming Wang , Yuxuan Zhou , Jiabing Yang , Ping Nie , Yan Huang , Wenhu Chen

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Large Vision-Language Models (LVLMs) have shown significant progress in video understanding, yet they face substantial challenges in tasks requiring precise spatiotemporal localization at the instance level. Existing methods primarily rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yiming Zhao , Yu Zeng , Wenxuan Huang , Zhen Fang , Qing Miao , Qisheng Su , Jiawei Zhao , Jiayin Cai , Lin Chen , Zehui Chen , Yukun Qi , Yao Hu , Xiaolong Jiang , Feng Zhao

Omnimodal large language models have made significant strides in unifying audio and visual modalities; however, they often face challenges in fine-grained cross-modal understanding and have difficulty with multimodal alignment. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Keda Tao , Wenjie Du , Bohan Yu , Weiqiang Wang , Jian Liu , Huan Wang

Referring-based Video Object Segmentation is a multimodal problem that requires producing fine-grained segmentation results guided by external cues. Traditional approaches to this task typically involve training specialized models, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tuyen Tran , Thao Minh Le , Truyen Tran