English
Related papers

Related papers: MaskClaw: Edge-Side Personalized Privacy Arbitrati…

200 papers

As language models are increasingly deployed as autonomous agents in high-stakes settings, ensuring that they reliably follow user-defined rules has become a critical safety concern. To this end, we study whether language models exhibit…

Machine Learning · Computer Science 2025-08-28 Dylan Sam , Alexander Robey , Andy Zou , Matt Fredrikson , J. Zico Kolter

The remarkable success of machine learning has fostered a growing number of cloud-based intelligent services for mobile users. Such a service requires a user to send data, e.g. image, voice and video, to the provider, which presents a…

Machine Learning · Computer Science 2020-06-12 Sicong Liu , Junzhao Du , Anshumali Shrivastava , Lin Zhong

GUI agents are rapidly shifting from multi-module pipelines to end-to-end, native vision-language models (VLMs) that perceive raw screenshots and directly interact with digital devices. Despite rapid progress on general GUI tasks, CAPTCHA…

Cryptography and Security · Computer Science 2026-03-26 Yuxi Chen , Haoyu Zhai , Chenkai Wang , Rui Yang , Lingming Zhang , Gang Wang , Huan Zhang

The paper introduces GUI-Owl-1.5, the latest native GUI agent model that features instruct/thinking variants in multiple sizes (2B/4B/8B/32B/235B) and supports a range of platforms (desktop, mobile, browser, and more) to enable cloud-edge…

Image data collected in the wild often contains private information such as faces and license plates, and responsible data release must ensure that this information stays hidden. At the same time, released data should retain its usefulness…

Machine Learning · Computer Science 2025-12-19 Saeed Mahloujifar , Narine Kokhlikyan , Chuan Guo , Kamalika Chaudhuri

Hybrid local--cloud agents enrich user requests with context from persistent working state before delegating capability-intensive subtasks to a cloud language model (CLM). While this enrichment can improve task success, it also exposes…

Cryptography and Security · Computer Science 2026-05-20 Shafizur Rahman Seeam , Zhengxiong Li , Zhiyuan Yu , Yimin , Chen , Yidan Hu

Recently, Multimodal Large Language Models (MLLMs) have been used as agents to control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) and generating corresponding commands. However, current agents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dongping Chen , Yue Huang , Siyuan Wu , Jingyu Tang , Liuyi Chen , Yilin Bai , Zhigang He , Chenlong Wang , Huichi Zhou , Yiqiang Li , Tianshuo Zhou , Yue Yu , Chujie Gao , Qihui Zhang , Yi Gui , Zhen Li , Yao Wan , Pan Zhou , Jianfeng Gao , Lichao Sun

AI-based sensing at wireless edge devices has the potential to significantly enhance Artificial Intelligence (AI) applications, particularly for vision and perception tasks such as in autonomous driving and environmental monitoring. AI…

Information Theory · Computer Science 2026-01-29 Mohamed Seif , Malcolm Egan , Andrea J. Goldsmith , H. Vincent Poor

Data sharing ecosystems connect providers, consumers, and intermediaries to facilitate the exchange and use of data for a wide range of downstream tasks. In sensitive domains such as healthcare, privacy is enforced as a hard constraint, any…

This paper introduces GUI-Owl, a foundational GUI agent model that achieves state-of-the-art performance among open-source end-to-end models on ten GUI benchmarks across desktop and mobile environments, covering grounding, question…

Artificial Intelligence · Computer Science 2025-09-03 Jiabo Ye , Xi Zhang , Haiyang Xu , Haowei Liu , Junyang Wang , Zhaoqing Zhu , Ziwei Zheng , Feiyu Gao , Junjie Cao , Zhengxi Lu , Jitong Liao , Qi Zheng , Fei Huang , Jingren Zhou , Ming Yan

Existing automated techniques for software documentation typically attempt to reason between two main sources of information: code and natural language. However, this reasoning process is often complicated by the lexical gap between more…

Large Language Models (LLMs) demonstrate impressive capabilities in natural language understanding and generation, but incur high communication overhead and privacy risks in cloud deployments, while facing compute and memory constraints…

Cryptography and Security · Computer Science 2025-12-01 Junfei Zhan , Haoxun Shen , Zheng Lin , Tengjiao He

This study proposes a privacy-preserving Visual SLAM framework for estimating camera poses and performing bundle adjustment with mixed line and point clouds in real time. Previous studies have proposed localization methods to estimate a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Mikiya Shibuya , Shinya Sumikura , Ken Sakurada

Users often struggle to navigate the privacy / publicity boundary in sharing images online: they may lack awareness of image privacy risks and/or the ability to apply effective mitigation strategies. To address this challenge, we introduce…

Human-Computer Interaction · Computer Science 2025-05-28 Kyzyl Monteiro , Yuchen Wu , Sauvik Das

We consider an edge computing scenario where users want to perform a linear computation on local, private data and a network-wide, public matrix. Users offload computations to edge servers located at the edge of the network, but do not want…

Information Theory · Computer Science 2020-10-20 Reent Schlegel , Siddhartha Kumar , Eirik Rosnes , Alexandre Graell i Amat

Large language model (LLM) agents face a structural tension: cloud agents provide strong reasoning but expose user data, while on-device agents preserve privacy at the cost of overall capability. Existing device-cloud designs treat this…

Machine Learning · Computer Science 2026-05-12 Liangqi Yuan , Wenzhi Fang , Shiqiang Wang , Christopher G. Brinton

Personalization despite being an effective solution to the problem information overload remains tricky on account of multiple dimensions to consider. Furthermore, the challenge of avoiding overdoing personalization involves estimation of a…

Information Retrieval · Computer Science 2017-11-09 Arjumand Younus , Muhammad Atif Qureshi

With the rise of personalized, persistent LLM agent frameworks such as OpenClaw, human-centered agentic social networks in which teams of collaborative AI agents serve individual users in a social network across multiple domains are…

Artificial Intelligence · Computer Science 2026-04-07 Prince Zizhuang Wang , Shuli Jiang

Inspired by the development of OpenClaw, there is a growing demand for mobile-based personal agents capable of handling complex and intuitive interactions. In this technical report, we introduce X-OmniClaw, a unified mobile agent designed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaoming Ren , Ru Zhen , Chao Li , Yang Song , Qiuxia Hou , Yanhao Zhang , Peng Liu , Qi Qi , Quanlong Zheng , Qi Wu , Zhenyi Liao , Binqiang Pan , Haobo Ji , Haonan Lu

With the increased capabilities at the edge (e.g., mobile device) and more stringent privacy requirement, it becomes a recent trend for deep learning-enabled applications to pre-process sensitive raw data at the edge and transmit the…

Cryptography and Security · Computer Science 2024-07-03 Shiming Wang , Zhe Ji , Liyao Xiang , Hao Zhang , Xinbing Wang , Chenghu Zhou , Bo Li