English
Related papers

Related papers: WebVoyager: Building an End-to-End Web Agent with …

200 papers

Large Language Models (LLMs) and LLM-based agents show great promise in accelerating scientific research. Existing benchmarks for measuring this potential and guiding future development continue to evolve from pure recall and rote knowledge…

Penetration testing is essential to ensure Web security, which can detect and fix vulnerabilities in advance, and prevent data leakage and serious consequences. The powerful inference capabilities of large language models (LLMs) have made…

Cryptography and Security · Computer Science 2024-11-05 Benlong Wu , Guoqiang Chen , Kejiang Chen , Xiuwei Shang , Jiapeng Han , Yanru He , Weiming Zhang , Nenghai Yu

The AgentSociety Challenge is the first competition in the Web Conference that aims to explore the potential of Large Language Model (LLM) agents in modeling user behavior and enhancing recommender systems on web platforms. The Challenge…

Information Retrieval · Computer Science 2025-02-27 Yuwei Yan , Yu Shang , Qingbin Zeng , Yu Li , Keyu Zhao , Zhiheng Zheng , Xuefei Ning , Tianji Wu , Shengen Yan , Yu Wang , Fengli Xu , Yong Li

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

Large language model (LLM) agents have demonstrated remarkable capabilities in software engineering and cybersecurity tasks, including code generation, vulnerability discovery, and automated testing. One critical but underexplored…

Software Engineering · Computer Science 2025-10-17 Bin Liu , Yanjie Zhao , Guoai Xu , Haoyu Wang

Large language models (LLMs) have recently demonstrated remarkable capabilities to comprehend human intentions, engage in reasoning, and design planning-like behavior. To further unleash the power of LLMs to accomplish complex tasks, there…

Text-rich visual understanding-the ability to process environments where dense textual content is integrated with visuals-is crucial for multimodal large language models (MLLMs) to interact effectively with structured environments. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Junpeng Liu , Tianyue Ou , Yifan Song , Yuxiao Qu , Wai Lam , Chenyan Xiong , Wenhu Chen , Graham Neubig , Xiang Yue

Web agents powered by Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within complex web-based environments, fulfilling a wide range of web navigation tasks. Despite…

Computation and Language · Computer Science 2024-02-26 Yang Deng , Xuan Zhang , Wenxuan Zhang , Yifei Yuan , See-Kiong Ng , Tat-Seng Chua

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Auto-GPT is an autonomous agent that leverages recent advancements in adapting Large Language Models (LLMs) for decision-making tasks. While there has been a growing interest in Auto-GPT stypled agents, questions remain regarding the…

Artificial Intelligence · Computer Science 2023-06-06 Hui Yang , Sifu Yue , Yunzhong He

Agent-based modeling (ABM) offers powerful insights into complex systems, but its practical utility has been limited by computational constraints and simplistic agent behaviors, especially when simulating large populations. Recent…

Multiagent Systems · Computer Science 2024-11-12 Ayush Chopra , Shashank Kumar , Nurullah Giray-Kuru , Ramesh Raskar , Arnau Quera-Bofarull

Evaluating multimodal large language models (MLLMs) is increasingly expensive, as the growing size and cross-modality complexity of benchmarks demand significant scoring efforts. To tackle with this difficulty, we introduce AutoJudger, an…

Computation and Language · Computer Science 2025-05-28 Xuanwen Ding , Chengjun Pan , Zejun Li , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Large Language Model (LLM)-based autonomous agents are expected to play a vital role in the evolution of 6G networks, by empowering real-time decision-making related to management and service provisioning to end-users. This shift…

Artificial Intelligence · Computer Science 2025-09-04 Ilias Chatzistefanidis , Navid Nikaein

As our world digitizes, web agents that can automate complex and monotonous tasks are becoming essential in streamlining workflows. This paper introduces an approach to improving web agent performance through multi-modal validation and…

Artificial Intelligence · Computer Science 2024-10-14 Ruhana Azam , Tamer Abuelsaad , Aditya Vempaty , Ashish Jagmohan

In transportation system demand modeling and simulation, agent-based models and microsimulations are current state-of-the-art approaches. However, existing agent-based models still have some limitations on behavioral realism and resource…

Artificial Intelligence · Computer Science 2025-04-08 Tianming Liu , Jirong Yang , Yafeng Yin

With the advancement of Large-Language Models (LLMs) and Large Vision-Language Models (LVMs), agents have shown significant capabilities in various tasks, such as data analysis, gaming, or code generation. Recently, there has been a surge…

Human-Computer Interaction · Computer Science 2024-05-09 Kihoon Son , Jinhyeon Kwon , DaEun Choi , Tae Soo Kim , Young-Ho Kim , Sangdoo Yun , Juho Kim

Existing AutoML systems have advanced the automation of machine learning (ML); however, they still require substantial manual configuration and expert input, particularly when handling multimodal data. We introduce MLZero, a novel…

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

Computation and Language · Computer Science 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia

Vision-Language Models (VLMs) have demonstrated significant potential for end-to-end autonomous driving. However, the field still lacks a practical platform that enables dynamic model updates, rapid validation, fair comparison, and…

Robotics · Computer Science 2025-09-16 Zhijie Qiao , Haowei Li , Zhong Cao , Henry X. Liu

We study the use of large language model-based agents for interacting with software via web browsers. Unlike prior work, we focus on measuring the agents' ability to perform tasks that span the typical daily work of knowledge workers…