English
Related papers

Related papers: Think Twice, Act Once: Verifier-Guided Action Sele…

200 papers

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

Computation and Language · Computer Science 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

Vision Language Models (VLMs) excel at visual question answering (VQA) but remain limited to snapshot vision, reasoning from static images. In contrast, embodied agents require ambulatory vision, actively moving to obtain more informative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Juil Koo , Daehyeon Choi , Sangwoo Youn , Phillip Y. Lee , Minhyuk Sung

Embodied intelligence empowers agents with a profound sense of perception, enabling them to respond in a manner closely aligned with real-world situations. Large Language Models (LLMs) delve into language instructions with depth, serving a…

Multimedia · Computer Science 2024-07-17 Shuyuan Liu , Jiawei Chen , Shouwei Ruan , Hang Su , Zhaoxia Yin

Deepfake detection remains a formidable challenge due to the complex and evolving nature of fake content in real-world scenarios. However, existing academic benchmarks suffer from severe discrepancies from industrial practice, typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hao Tan , Jun Lan , Zichang Tan , Ajian Liu , Chuanbiao Song , Senyuan Shi , Huijia Zhu , Weiqiang Wang , Jun Wan , Zhen Lei

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Large Language Models (LLMs) have demonstrated impressive capabilities in complex reasoning tasks, yet they still struggle to reliably verify the correctness of their own outputs. Existing solutions to this verification challenge often…

Computation and Language · Computer Science 2025-06-13 Yuhua Jiang , Yuwen Xiong , Yufeng Yuan , Chao Xin , Wenyuan Xu , Yu Yue , Qianchuan Zhao , Lin Yan

Large language model (LLM) based task plans and corresponding human demonstrations for embodied AI may be noisy, with unnecessary actions, redundant navigation, and logical errors that reduce policy quality. We propose an iterative…

Artificial Intelligence · Computer Science 2026-01-01 Ananth Hariharan , Vardhan Dongre , Dilek Hakkani-Tür , Gokhan Tur

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

Embodied AI is widely recognized as a cornerstone of artificial general intelligence (AGI) because it involves controlling embodied agents to perform tasks in the physical world. Building on the success of large language models (LLMs) and…

Robotics · Computer Science 2026-05-04 Yueen Ma , Zixing Song , Yuzheng Zhuang , Jianye Hao , Irwin King

Leveraging massive knowledge from large language models (LLMs), recent machine learning models show notable successes in general-purpose task solving in diverse domains such as computer vision and robotics. However, several significant…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Jiangyong Huang , Silong Yong , Xiaojian Ma , Xiongkun Linghu , Puhao Li , Yan Wang , Qing Li , Song-Chun Zhu , Baoxiong Jia , Siyuan Huang

Recent advances in embodied Vision-Language Agentic Systems (VLAS), powered by large vision-language models (LVLMs), enable AI systems to perceive and reason over real-world scenes. Within this context, environmental signals such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiamin Chang , Minhui Xue , Ruoxi Sun , Shuchao Pang , Salil S. Kanhere , Hammond Pearce

Large-scale generative models are shown to be useful for sampling meaningful candidate solutions, yet they often overlook task constraints and user preferences. Their full power is better harnessed when the models are coupled with external…

Artificial Intelligence · Computer Science 2024-08-13 Lin Guan , Yifan Zhou , Denis Liu , Yantian Zha , Heni Ben Amor , Subbarao Kambhampati

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

Multimodal large language models (MLLMs) have advanced vision-language reasoning and are increasingly deployed in embodied agents. However, significant limitations remain: MLLMs generalize poorly across digital-physical spaces and…

While large language models (LLMs) excel in a simulated world of texts, they struggle to interact with the more realistic world without perceptions of other modalities such as visual or audio signals. Although vision-language models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Yijun Yang , Tianyi Zhou , Kanxue Li , Dapeng Tao , Lusong Li , Li Shen , Xiaodong He , Jing Jiang , Yuhui Shi

By utilizing more computational resources at test-time, large language models (LLMs) can improve without additional training. One common strategy uses verifiers to evaluate candidate outputs. In this work, we propose a novel scaling…

Artificial Intelligence · Computer Science 2025-02-28 Shalev Lifshitz , Sheila A. McIlraith , Yilun Du

We present Verified Multi-Agent Orchestration (VMAO), a framework that coordinates specialized LLM-based agents through a verification-driven iterative loop. Given a complex query, our system decomposes it into a directed acyclic graph…

Artificial Intelligence · Computer Science 2026-03-17 Xing Zhang , Yanwei Cui , Guanghui Wang , Wei Qiu , Ziyuan Li , Fangwei Han , Yajing Huang , Hengzhi Qiu , Bing Zhu , Peiyang He