English
Related papers

Related papers: Multimodal Auto Validation For Self-Refinement in …

200 papers

Verification and Validation (V&V) is a series of activities, technical and managerial, which performed by system tester not the system developer in order to improve the system quality, system reliability and assure that product satisfies…

Software Engineering · Computer Science 2012-10-16 A. Al-Neaimi , S. Qatawneh , Nedhal Al Saiyd

Multi-agent systems provide a powerful way to extend large language models (LLMs) by decomposing a complex task into specialized subtasks handled by different agents. However, their performance is often hindered by error propagation,…

Machine Learning · Computer Science 2026-05-14 Zheng Wang , Yuang Liu , Yangkai Ding

This paper aims to provide an innovative machine learning-based solution to automate security testing tasks for web applications, ensuring the correct functioning of all components while reducing project maintenance costs. Reinforcement…

What if a browser agent could learn your work simply by watching you do it? We present cotomi Act, a browser-based computer-using agent that combines reliable multi-step task execution with persistent organizational knowledge learned from…

Artificial Intelligence · Computer Science 2026-05-06 Masafumi Oyamada , Kunihiro Takeoka , Kosuke Akimoto , Ryoma Obara , Masafumi Enomoto , Haochen Zhang , Daichi Haraguchi , Takuya Tamura

This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Huy Hoan Le , Van Sy Thinh Nguyen , Thi Le Chi Dang , Vo Thanh Khang Nguyen , Truong Thanh Hung Nguyen , Hung Cao

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

LLM agents are increasingly deployed to plan, retrieve, and write with tools, yet evaluation still leans on static benchmarks and small human studies. We present the Agent-Testing Agent (ATA), a meta-agent that combines static code…

Computation and Language · Computer Science 2025-08-26 Sameer Komoravolu , Khalil Mrini

In this paper, we introduce Auto-Intent, a method to adapt a pre-trained large language model (LLM) as an agent for a target domain without direct fine-tuning, where we empirically focus on web navigation tasks. Our approach first discovers…

Computation and Language · Computer Science 2024-10-31 Jaekyeom Kim , Dong-Ki Kim , Lajanugen Logeswaran , Sungryull Sohn , Honglak Lee

Recent progress in large language models (LLMs) has enabled the development of autonomous web agents capable of navigating and interacting with real websites. However, evaluating such agents remains challenging due to the instability and…

Information Retrieval · Computer Science 2025-08-14 Zihao Sun , Ling Chen

Multimodal Retrieval-Augmented Generation (mRAG) has emerged as a promising solution to address the temporal limitations of Multimodal Large Language Models (MLLMs) in real-world scenarios like news analysis and trending topics. However,…

Artificial Intelligence · Computer Science 2025-08-13 Yuechen Wang , Yuming Qiao , Dan Meng , Jun Yang , Haonan Lu , Zhenyu Yang , Xudong Zhang

Recent advances in large language models (LLMs) have enabled a new generation of autonomous agents that operate over sustained periods and manage sensitive resources on behalf of users. Trusted for their ability to act without direct…

Cryptography and Security · Computer Science 2025-12-19 Artem Grigor , Christian Schroeder de Witt , Simon Birnbach , Ivan Martinovic

The deployment of AI models in clinical practice faces a critical challenge: models achieving expert-level performance on benchmarks can fail catastrophically when confronted with real-world variations in medical imaging. Minor shifts in…

Artificial Intelligence · Computer Science 2025-07-09 Lukas Kuhn , Florian Buettner

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

By utilizing more computational resources at test-time, large language models (LLMs) can improve without additional training. One common strategy uses verifiers to evaluate candidate outputs. In this work, we propose a novel scaling…

Artificial Intelligence · Computer Science 2025-02-28 Shalev Lifshitz , Sheila A. McIlraith , Yilun Du

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida

LLM-based multi-agent systems have demonstrated significant capabilities across diverse domains. However, the task performance and efficiency are fundamentally constrained by their collaboration strategies. Prevailing approaches rely on…

Multiagent Systems · Computer Science 2025-12-02 Qingwen Yang , Feiyu Qu , Tiezheng Guo , Yanyi Liu , Yingyou Wen

The enhancement of Visual Language Models (VLMs) has traditionally relied on knowledge distillation from larger, more capable models. This dependence creates a fundamental bottleneck for improving state-of-the-art systems, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Ming-Chang Chiu , Fuxiao Liu , Karan Sapra , Andrew Tao , Yaser Jacoob , Xuezhe Ma , Zhiding Yu , Guilin Liu

Web-based 'deep research' agents aim to solve complex question - answering tasks through long-horizon interactions with online tools. These tasks remain challenging, as the underlying language models are often not optimized for long-horizon…

Computation and Language · Computer Science 2025-10-17 Shrey Pandit , Xuan-Phi Nguyen , Yifei Ming , Austin Xu , Jiayu Wang , Caiming Xiong , Shafiq Joty

We present a scalable pipeline for automatically generating high-quality training data for web agents. In particular, a major challenge in identifying high-quality training instances is trajectory evaluation - quantifying how much progress…

Artificial Intelligence · Computer Science 2026-02-16 Lajanugen Logeswaran , Jaekyeom Kim , Sungryull Sohn , Creighton Glasscock , Honglak Lee