English
Related papers

Related papers: WebVoyager: Building an End-to-End Web Agent with …

200 papers

Multimodal search has become increasingly important in providing users with a natural and effective way to ex-press their search intentions. Images offer fine-grained details of the desired products, while text allows for easily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Oriol Barbany , Michael Huang , Xinliang Zhu , Arnab Dhua

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

Human-Computer Interaction · Computer Science 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

In this study, we explore the potential of Multimodal Large Language Models (MLLMs) in improving embodied decision-making processes for agents. While Large Language Models (LLMs) have been widely used due to their advanced reasoning skills…

Artificial Intelligence · Computer Science 2023-11-29 Liang Chen , Yichi Zhang , Shuhuai Ren , Haozhe Zhao , Zefan Cai , Yuchi Wang , Peiyi Wang , Tianyu Liu , Baobao Chang

Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetitive errors and lack…

Artificial Intelligence · Computer Science 2025-11-18 Genglin Liu , Shijie Geng , Sha Li , Hejie Cui , Sarah Zhang , Xin Liu , Tianyi Liu

With the rise of large language models (LLMs), LLM agents capable of autonomous reasoning, planning, and executing complex tasks have become a frontier in artificial intelligence. However, how to translate the research on general agents…

Large Language Model (LLM) Agents have demonstrated remarkable capabilities in task automation and intelligent decision-making, driving the widespread adoption of agent development frameworks such as LangChain and AutoGen. However, these…

Artificial Intelligence · Computer Science 2025-10-10 Jiabin Tang , Tianyu Fan , Chao Huang

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model…

Information Retrieval · Computer Science 2025-03-05 Qiyao Peng , Hongtao Liu , Hua Huang , Qing Yang , Minglai Shao

The use of Large Language Models (LLMs) for autonomous code generation is gaining attention in emerging technologies. As LLM capabilities expand, they offer new possibilities such as code refactoring, security enhancements, and legacy…

Large Language Models (LLMs) have the potential to fundamentally change the way people engage in computer programming. Agent-based modeling (ABM) has become ubiquitous in natural and social sciences and education, yet no prior studies have…

Human-Computer Interaction · Computer Science 2024-02-02 John Chen , Xi Lu , Michael Rejtig , David Du , Ruth Bagley , Michael S. Horn , Uri J. Wilensky

LLM-based autonomous agents often fail to execute complex web tasks that require dynamic interaction due to the inherent uncertainty and complexity of these environments. Existing LLM-based web agents typically rely on rigid,…

Artificial Intelligence · Computer Science 2024-08-29 Yao Zhang , Zijian Ma , Yunpu Ma , Zhen Han , Yu Wu , Volker Tresp

The integration of Large Language Models (LLMs) into software engineering has driven a transition from traditional rule-based systems to autonomous agentic systems capable of solving complex problems. However, systematic progress is…

Software Engineering · Computer Science 2025-10-24 Jiale Guo , Suizhi Huang , Mei Li , Dong Huang , Xingsheng Chen , Regina Zhang , Zhijiang Guo , Han Yu , Siu-Ming Yiu , Pietro Lio , Kwok-Yan Lam

We present WebGLM, a web-enhanced question-answering system based on the General Language Model (GLM). Its goal is to augment a pre-trained large language model (LLM) with web search and retrieval capabilities while being efficient for…

Computation and Language · Computer Science 2023-06-14 Xiao Liu , Hanyu Lai , Hao Yu , Yifan Xu , Aohan Zeng , Zhengxiao Du , Peng Zhang , Yuxiao Dong , Jie Tang

Planning has been part of the core pursuit for artificial intelligence since its conception, but earlier AI agents mostly focused on constrained settings because many of the cognitive substrates necessary for human-level planning have been…

Computation and Language · Computer Science 2024-10-24 Jian Xie , Kai Zhang , Jiangjie Chen , Tinghui Zhu , Renze Lou , Yuandong Tian , Yanghua Xiao , Yu Su

People commonly leverage structured content to accelerate knowledge acquisition and research problem solving. Among these, roadmaps guide researchers through hierarchical subtasks to solve complex research problems step by step. Despite…

Computation and Language · Computer Science 2026-05-01 Jiacheng Liu , Zichen Tang , Zhongjun Yang , Xinyi Hu , Xueyuan Lin , Linwei Jia , Ruofei Bai , Rongjin Li , Shiyao Peng , Haocheng Gao , Haihong E

Large Language Models (LLMs) have facilitated the definition of autonomous intelligent agents. Such agents have already demonstrated their potential in solving complex tasks in different domains. And they can further increase their…

Software Engineering · Computer Science 2025-06-30 Adem Ait , Javier Luis Cánovas Izquierdo , Jordi Cabot

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Visual language model (VLM) agents show great promise in automating end-to-end (E2E) web testing against requirements in natural language. However, the probabilistic nature of language models can have inherent hallucinations. Therefore,…

Software Engineering · Computer Science 2026-04-24 Xiwen Teoh , Yun Lin , Duc-Minh Nguyen , Ruofei Ren , Wenjie Zhang , Jin Song Dong

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

We introduce WebGames, a comprehensive benchmark suite designed to evaluate general-purpose web-browsing AI agents through a collection of 50+ interactive challenges. These challenges are specifically crafted to be straightforward for…

Machine Learning · Computer Science 2025-02-26 George Thomas , Alex J. Chan , Jikun Kang , Wenqi Wu , Filippos Christianos , Fraser Greenlee , Andy Toulis , Marvin Purtorab

As multimodal large language models (MLLMs) advance, MLLM-based virtual agents have demonstrated remarkable performance. However, existing benchmarks face significant limitations, including uncontrollable task complexity, extensive manual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wendong Bu , Yang Wu , Qifan Yu , Minghe Gao , Bingchen Miao , Zhenkui Zhang , Kaihang Pan , Yunfei Li , Mengze Li , Wei Ji , Juncheng Li , Siliang Tang , Yueting Zhuang
‹ Prev 1 4 5 6 7 8 10 Next ›