English
Related papers

Related papers: WebChoreArena: Evaluating Web Browsing Agents on R…

200 papers

LLM-based web agents have the potential to automate long-running web tasks, such as searching for products in multiple e-shops and subsequently ordering the cheapest products that meet the users needs. Benchmarks for evaluating web agents…

Computation and Language · Computer Science 2026-05-01 Ralph Peeters , Aaron Steiner , Luca Schwarz , Julian Yuya Caspary , Christian Bizer

Despite the remarkable progress of large language models (LLMs), the capabilities of standalone LLMs have begun to plateau when tackling real-world, complex tasks that require interaction with external tools and dynamic environments.…

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

While Large Language Models (LLMs) can exhibit impressive proficiency in isolated, short-term tasks, they often fail to maintain coherent performance over longer time horizons. In this paper, we present Vending-Bench, a simulated…

Artificial Intelligence · Computer Science 2025-02-25 Axel Backlund , Lukas Petersson

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

We present WebGLM, a web-enhanced question-answering system based on the General Language Model (GLM). Its goal is to augment a pre-trained large language model (LLM) with web search and retrieval capabilities while being efficient for…

Computation and Language · Computer Science 2023-06-14 Xiao Liu , Hanyu Lai , Hao Yu , Yifan Xu , Aohan Zeng , Zhengxiao Du , Peng Zhang , Yuxiao Dong , Jie Tang

Due to the excellent capacities of large language models (LLMs), it becomes feasible to develop LLM-based agents for reliable user simulation. Considering the scarcity and limit (e.g., privacy issues) of real user data, in this paper, we…

Information Retrieval · Computer Science 2024-02-28 Ruiyang Ren , Peng Qiu , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Hua Wu , Ji-Rong Wen , Haifeng Wang

The rise of Large Reasoning Models (LRMs) signifies a paradigm shift toward advanced computational reasoning. Yet, this progress disrupts traditional agent frameworks, traditionally anchored by execution-oriented Large Language Models…

Artificial Intelligence · Computer Science 2025-05-28 Xueyang Zhou , Guiyao Tie , Guowen Zhang , Weidong Wang , Zhigang Zuo , Di Wu , Duanfeng Chu , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Transcending human cognitive limitations represents a critical frontier in LLM training. Proprietary agentic systems like DeepResearch have demonstrated superhuman capabilities on extremely complex information-seeking benchmarks such as…

Large Language Models (LLMs) and LLM-based agents show great promise in accelerating scientific research. Existing benchmarks for measuring this potential and guiding future development continue to evolve from pure recall and rote knowledge…

Web browsing agents powered by large language models (LLMs) have shown tremendous potential in automating complex web-based tasks. Existing approaches typically rely on large LLMs (e.g., GPT-4o) to explore web environments and generate…

Multiagent Systems · Computer Science 2025-03-10 Ruichen Zhang , Mufan Qiu , Zhen Tan , Mohan Zhang , Vincent Lu , Jie Peng , Kaidi Xu , Leandro Z. Agudelo , Peter Qian , Tianlong Chen

Agent self-improvement, where the backbone Large Language Model (LLM) of the agent are trained on trajectories sampled autonomously based on their own policies, has emerged as a promising approach for enhancing performance. Recent…

Computation and Language · Computer Science 2025-08-22 Tianqing Fang , Hongming Zhang , Zhisong Zhang , Kaixin Ma , Wenhao Yu , Haitao Mi , Dong Yu

Web agents powered by Large Language Models (LLMs) show promise for next-generation AI, but their limited reasoning in uncertain, dynamic web environments hinders robust deployment. In this paper, we identify key reasoning skills essential…

Computation and Language · Computer Science 2025-09-19 Minda Hu , Tianqing Fang , Jianshu Zhang , Junyu Ma , Zhisong Zhang , Jingyan Zhou , Hongming Zhang , Haitao Mi , Dong Yu , Irwin King

Large Language Model(LLM)-based agents have shown strong capabilities in web information seeking, with reinforcement learning (RL) becoming a key optimization paradigm. However, planning remains a bottleneck, as existing methods struggle…

Computation and Language · Computer Science 2026-01-08 Xinmiao Yu , Liwen Zhang , Xiaocheng Feng , Yong Jiang , Bing Qin , Pengjun Xie , Jingren Zhou

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with…

Computation and Language · Computer Science 2025-10-13 Daocheng Fu , Jianbiao Mei , Licheng Wen , Xuemeng Yang , Cheng Yang , Rong Wu , Tao Hu , Siqi Li , Yufan Shen , Xinyu Cai , Pinlong Cai , Botian Shi , Yong Liu , Yu Qiao

Decision-making is a complex process requiring diverse abilities, making it an excellent framework for evaluating Large Language Models (LLMs). Researchers have examined LLMs' decision-making through the lens of Game Theory. However,…

Artificial Intelligence · Computer Science 2025-03-07 Jen-tse Huang , Eric John Li , Man Ho Lam , Tian Liang , Wenxuan Wang , Youliang Yuan , Wenxiang Jiao , Xing Wang , Zhaopeng Tu , Michael R. Lyu

The development of autonomous machine learning (ML) agents capable of end-to-end data science workflows represents a significant frontier in artificial intelligence. These agents must orchestrate complex sequences of data analysis, feature…

Machine Learning · Computer Science 2026-02-24 Yaswanth Chittepu , Raghavendra Addanki , Tung Mai , Anup Rao , Branislav Kveton

AI research agents accelerate ML research by automating hypothesis generation, experimentation, and empirical refinement. Existing agent strategies range from greedy hill-climbing to tree search and evolutionary optimization, yet which…

Large Language Models (LLMs) have shown strong potential as conversational agents. Yet, their effectiveness remains limited by deficiencies in robust long-term memory, particularly in complex, long-term web-based services such as online…

Computation and Language · Computer Science 2026-02-03 Tiantian Chen , Jiaqi Lu , Ying Shen , Lin Zhang

Large language models (LLMs) increasingly serve as interactive social agents, yet their ability to maintain coherent and authentic persona-level role-playing remains limited, particularly in realistic social scenarios. Existing research…

Artificial Intelligence · Computer Science 2026-05-19 Wenlong Shi , Jianxun Lian , Mingqi Wu , Haiming Qin , Mingyang Zhou , Xing Xie , Naipeng Chao , Hao Liao