English
Related papers

Related papers: Multimodal Auto Validation For Self-Refinement in …

200 papers

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

Computation and Language · Computer Science 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

We propose a method to efficiently learn diverse strategies in reinforcement learning for query reformulation in the tasks of document retrieval and question answering. In the proposed framework an agent consists of multiple specialized…

Machine Learning · Computer Science 2018-12-27 Rodrigo Nogueira , Jannis Bulian , Massimiliano Ciaramita

LLM-based autonomous agents often fail to execute complex web tasks that require dynamic interaction due to the inherent uncertainty and complexity of these environments. Existing LLM-based web agents typically rely on rigid,…

Artificial Intelligence · Computer Science 2024-08-29 Yao Zhang , Zijian Ma , Yunpu Ma , Zhen Han , Yu Wu , Volker Tresp

Automated paper reproduction has emerged as a promising approach to accelerate scientific research, employing multi-step workflow frameworks to systematically convert academic papers into executable code. However, existing frameworks often…

Artificial Intelligence · Computer Science 2025-12-03 Zijie Lin , Qilin Cai , Liang Shen , Mingjun Xiao

Automated answer validation can help improve learning outcomes by providing appropriate feedback to learners, and by making question answering systems and online learning solutions more widely available. There have been some works in…

Recent advances in multimodal web agents often rely on increased inference-time computation, including rollout search, verifier passes, offline skill discovery, and specialist model stacks. This raises a central question: can a web agent…

Artificial Intelligence · Computer Science 2026-05-27 Yubo Li , Yidi Miao , Yuntian Shen , Yuxin Liu

Multi-agent systems powered by large language models have demonstrated remarkable capabilities across diverse domains, yet existing automated design approaches seek monolithic solutions that fail to adapt resource allocation based on query…

Artificial Intelligence · Computer Science 2025-10-06 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Liu

Automatic multi-agent systems aim to instantiate agent workflows without relying on manually designed or fixed orchestration. However, existing automatic MAS approaches remain only partially adaptive: they either perform training-free…

Artificial Intelligence · Computer Science 2026-05-15 Yaolun Zhang , Yujie Zhao , Nan Wang , Yiran Wu , Jiayu Chang , Yizhao Chen , Qingyun Wu , Jishen Zhao , Huazheng Wang

Modern web test suites rot. A UI refactor breaks locators, a timing change causes race conditions, and within weeks developers abandon the suite entirely. This paper presents an AI-driven autonomous testing framework that addresses these…

Cryptography and Security · Computer Science 2026-05-18 Vinil Pasupuleti , Siva Rama Krishna Varma Bayyavarapu , Shrey Tyagi

Real-world multimodal agents solve multi-step workflows grounded in visual evidence. For example, an agent can troubleshoot a device by linking a wiring photo to a schematic and validating the fix with online documentation, or plan a trip…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaochen Su , Jincheng Gao , Hangyu Guo , Zhenhua Liu , Lueyang Zhang , Xinyu Geng , Shijue Huang , Peng Xia , Guanyu Jiang , Cheng Wang , Yue Zhang , Yi R. Fung , Junxian He

Addressing intricate real-world problems necessitates in-depth information seeking and multi-step reasoning. Recent progress in agentic systems, exemplified by Deep Research, underscores the potential for autonomous multi-step research. In…

Computation and Language · Computer Science 2025-08-12 Jialong Wu , Baixuan Li , Runnan Fang , Wenbiao Yin , Liwen Zhang , Zhengwei Tao , Dingchu Zhang , Zekun Xi , Gang Fu , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

This paper introduces a multi-agent application system designed to enhance office collaboration efficiency and work quality. The system integrates artificial intelligence, machine learning, and natural language processing technologies,…

Artificial Intelligence · Computer Science 2025-04-08 Songtao Sun , Jingyi Li , Yuanfei Dong , Haoguang Liu , Chenxin Xu , Fuyang Li , Qiang Liu

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

Data science and engineering workflows often span multiple stages, from warehousing to orchestration, using tools like BigQuery, dbt, and Airbyte. As vision language models (VLMs) advance in multimodal understanding and code generation,…

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jianglin Lu , Yuanwei Wu , Ziyi Zhao , Hongcheng Wang , Felix Jimenez , Abrar Majeedi , Yun Fu

As autonomous robots are deployed in increasingly complex environments, platform degradation, environmental uncertainties, and deviations from validated operation conditions can make it difficult for human partners to understand robot…

Robotics · Computer Science 2023-03-06 Nicholas Conlon , Nisar R. Ahmed , Daniel Szafir

We present a novel approach for claim verification from tabular data documents. Recent LLM-based approaches either employ complex pretraining/fine-tuning or decompose verification into subtasks, often lacking comprehensive explanations and…

Computation and Language · Computer Science 2026-04-21 Rudra Ranajee Saha , Laks V. S. Lakshmanan , Raymond T. Ng

This study presents a modular, multi-agent system for the automated review of highly structured enterprise business documents using AI agents. Unlike prior solutions focused on unstructured texts or limited compliance checks, this framework…

Computation and Language · Computer Science 2025-07-01 Sudip Dasgupta , Himanshu Shankar

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap