English
Related papers

Related papers: SPILLage: Agentic Oversharing on the Web

200 papers

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Fulfilling user needs through Large Language Model multi-turn, multi-step tool-use is rarely a straightforward process. Real user interactions are inherently wild, being intricate, messy, and flexible. We identify three key challenges from…

Human-Computer Interaction · Computer Science 2026-04-09 Peijie Yu , Wei Liu , Yifan Yang , Jinjian Li , Zelong Zhang , Xiao Feng , Feng Zhang

Web agents promise to automate complex browser tasks, but current methods remain brittle -- relying on step-by-step UI interactions and heavy LLM reasoning that break under dynamic layouts and long horizons. Humans, by contrast, exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Viraj Prabhu , Yutong Dai , Matthew Fernandez , Jing Gu , Krithika Ramakrishnan , Yanqi Luo , Silvio Savarese , Caiming Xiong , Junnan Li , Zeyuan Chen , Ran Xu

The emergence of AI agents powered by large language models (LLMs) marks a pivotal shift toward the Agentic Web, a new phase of the internet defined by autonomous, goal-driven interactions. In this paradigm, agents interact directly with…

Agents, as user-centric tools, are increasingly deployed for human task delegation, assisting with a broad spectrum of requests by generating thoughts, engaging with user proxies, and producing action plans. However, agents based on large…

Multiagent Systems · Computer Science 2024-10-02 Wenyue Hua , Mengting Wan , Shashank Vadrevu , Ryan Nadel , Yongfeng Zhang , Chi Wang

As Large Language Models increasingly automate complex, long-horizon tasks such as \emph{vibe coding}, a supervision gap has emerged. While models excel at execution, users often struggle to guide them effectively due to insufficient domain…

Artificial Intelligence · Computer Science 2026-02-09 Enyu Zhou , Zhiheng Xi , Long Ma , Zhihao Zhang , Shihan Dou , Zhikai Lei , Guoteng Wang , Rui Zheng , Hang Yan , Tao Gui , Qi Zhang , Xuanjing Huang

Large Language Model (LLM) web agents often struggle with long-horizon web navigation and web task completion in new websites, producing inefficient action sequences unless fine-tuned on environment-specific data. We show that…

Web scraping has historically required technical expertise in HTML parsing, session management, and authentication circumvention, which limited large-scale data extraction to skilled developers. We argue that large language models (LLMs)…

Cryptography and Security · Computer Science 2026-01-13 Arth Bhardwaj , Nirav Diwan , Gang Wang

LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test…

Computation and Language · Computer Science 2026-05-19 Nivya Talokar , Ayush K Tarun , Murari Mandal , Maksym Andriushchenko , Antoine Bosselut

Agentic LLM AI agents are often little more than autonomous chatbots: actors following scripts, often controlled by an unreliable director. This work introduces a bottom-up framework that situates AI agents in their environment, with all…

Artificial Intelligence · Computer Science 2025-09-04 Peter J. Bentley , Soo Ling Lim , Fuyuki Ishikawa

Multi-agent systems coordinate LLM-based agents to perform tasks on users' behalf. In real-world applications, multi-agent systems will inevitably interact with untrusted inputs, such as malicious Web content, files, email attachments, and…

Cryptography and Security · Computer Science 2025-09-16 Harold Triedman , Rishi Jha , Vitaly Shmatikov

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Online social networks have transformed the ways in which political mobilization messages are disseminated, raising new questions about how peer influence operates at scale. Building on the landmark 61-million-person Facebook experiment…

Social and Information Networks · Computer Science 2025-10-31 Sadegh Shirani , Mohsen Bayati

Personalized computer-use agents are rapidly moving from expert communities into mainstream use. Unlike conventional chatbots, these systems can install skills, invoke tools, access private resources, and modify local environments on users'…

Cryptography and Security · Computer Science 2026-04-01 Zifan Peng , Mingchen Li

User interactions with LLMs are shaped by prior experiences and individual exploration, but in-lab studies do not provide system designers with visibility into these in-the-wild factors. This work explores a new approach to studying…

Human-Computer Interaction · Computer Science 2026-05-08 Shengqi Zhu , Jeffrey M. Rzeszotarski , David Mimno

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models (VLMs). These agents make visual decisions at scale, deciding what to click, recommend, or buy. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Manuel Cherep , Pranav M R , Pattie Maes , Nikhil Singh

Spreadsheets are ubiquitous across the World Wide Web, playing a critical role in enhancing work efficiency across various domains. Large language model (LLM) has been recently attempted for automatic spreadsheet manipulation but has not…

Artificial Intelligence · Computer Science 2025-03-04 Yibin Chen , Yifu Yuan , Zeyu Zhang , Yan Zheng , Jinyi Liu , Fei Ni , Jianye Hao , Hangyu Mao , Fuzheng Zhang

Online health resources and large language models (LLMs) are increasingly used as a first point of contact for medical decision-making, yet their reliability in healthcare remains limited by low accuracy, lack of transparency, and…

Artificial Intelligence · Computer Science 2026-04-22 Yujia Liu , Sophia Yu , Hongyue Jin , Jessica Wen , Alexander Qian , Terrence Lee , Mattheus Ramsis , Gi Won Choi , Lianhui Qin , Xin Liu , Edward J. Wang

Peer review is fundamental to the integrity and advancement of scientific publication. Traditional methods of peer review analyses often rely on exploration and statistics of existing peer review data, which do not adequately address the…

Computation and Language · Computer Science 2026-05-12 Yiqiao Jin , Qinlin Zhao , Yiyang Wang , Hao Chen , Kaijie Zhu , Yijia Xiao , Jindong Wang