English
Related papers

Related papers: PrivacyBench: A Conversational Benchmark for Evalu…

200 papers

The widespread deployment of deep learning models in privacy-sensitive domains has amplified concerns regarding privacy risks, particularly those stemming from gradient leakage during training. Current privacy assessments primarily rely on…

Machine Learning · Computer Science 2025-02-13 Jiayang Meng , Tao Huang , Hong Chen , Xin Shi , Qingyu Huang , Chen Hou

Conversational AI (CAI) systems which encompass voice- and text-based assistants are on the rise and have been largely integrated into people's everyday lives. Despite their widespread adoption, users voice concerns regarding privacy,…

Human-Computer Interaction · Computer Science 2025-02-27 Anna Leschanowsky , Silas Rech , Birgit Popp , Tom Bäckström

Personal AI assistants are beginning to act as delegates with access to calendars, inboxes, and user preferences. Calendar scheduling makes the trust problem concrete: an assistant must coordinate with other assistants while deciding what…

Multiagent Systems · Computer Science 2026-05-29 Chelsea Zou , Yiheng Yao , Selena She , Noah Goodman , Robert D. Hawkins

Privacy in Social Network Sites (SNSs) like Facebook or Instagram is closely related to people's self-disclosure decisions and their ability to foresee the consequences of sharing personal information with large and diverse audiences.…

Computers and Society · Computer Science 2020-11-13 Nicolas E. Díaz Ferreyra , Esma Aïmeur , Hicham Hage , Maritta Heisel , Catherine García van Hoogstraten

Romantic AI chatbots have quickly attracted users, but their emotional use raises concerns about privacy and safety. As people turn to these systems for intimacy, comfort, and emotionally significant interaction, they often disclose highly…

Computers and Society · Computer Science 2026-03-26 Kazi Ababil Azam , Imtiaz Karim , Dipto Das

As Artificial Intelligence (AI) systems become increasingly integrated into various aspects of daily life, concerns about privacy and ethical accountability are gaining prominence. This study explores stakeholder perspectives on privacy in…

Computers and Society · Computer Science 2025-03-18 Ajay Kumar Shrestha , Sandhya Joshi

Privacy preservation is a crucial component of any real-world application. But, in applications relying on machine learning backends, privacy is challenging because models often capture more than what the model was initially trained for,…

Computation and Language · Computer Science 2021-10-05 Mimansa Jaiswal , Emily Mower Provost

This systematic literature review investigates perceptions, concerns, and expectations of young digital citizens regarding privacy in artificial intelligence (AI) systems, focusing on social media platforms, educational technology, gaming…

Computers and Society · Computer Science 2025-12-16 Ajay Kumar Shrestha , Ankur Barthwal , Molly Campbell , Austin Shouli , Saad Syed , Sandhya Joshi , Julita Vassileva

The proliferation of AI agents, with their complex and context-dependent actions, renders conventional privacy paradigms obsolete. This position paper argues that the current model of privacy management, rooted in a user's unilateral…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Ying Ma , Jingruo Chen , Simin Li , Xin Yi , Hewu Li

AI fairness measurements, including tests for equal treatment, often take the form of disaggregated evaluations of AI systems. Such measurements are an important part of Responsible AI operations. These measurements compare system…

Machine Learning · Computer Science 2024-09-18 Saikrishna Badrinarayanan , Osonde Osoba , Miao Cheng , Ryan Rogers , Sakshi Jain , Rahul Tandra , Natesh S. Pillai

The rapid development of language models (LMs) brings unprecedented accessibility and usage for both models and users. On the one hand, powerful LMs achieve state-of-the-art performance over numerous downstream NLP tasks. On the other hand,…

Computation and Language · Computer Science 2024-06-04 Haoran Li , Dadi Guo , Donghao Li , Wei Fan , Qi Hu , Xin Liu , Chunkit Chan , Duanyi Yao , Yuan Yao , Yangqiu Song

AI intensive systems that operate upon user data face the challenge of balancing data utility with privacy concerns. We propose the idea and present the prototype of an open-source tool called Privacy Utility Trade-off (PUT) Workbench which…

Cryptography and Security · Computer Science 2019-02-06 Saurabh Srivastava , Vinay P. Namboodiri , T. V. Prabhakar

Cybersecurity spans multiple interconnected domains, complicating the development of meaningful, labor-relevant benchmarks. Existing benchmarks assess isolated skills rather than integrated performance. We find that pre-trained knowledge of…

As GUI agents increasingly rely on screenshots to perceive and operate digital environments, they may inadvertently expose sensitive information such as identities, accounts, locations, and behavioral traces. While existing benchmarks…

Cryptography and Security · Computer Science 2026-05-14 Yanxi Wang , Zhiling Zhang , Wenbo Zhou , Weiming Zhang , Jie Zhang , Qiannan Zhu , Yu Shi , Shuxin Zheng , Jiyan He

Human safety awareness gaps often prevent the timely recognition of everyday risks. In solving this problem, a proactive safety artificial intelligence (AI) system would work better than a reactive one. Instead of just reacting to users'…

Computation and Language · Computer Science 2025-10-21 Youliang Yuan , Wenxiang Jiao , Yuejin Xie , Chihao Shen , Menghan Tian , Wenxuan Wang , Jen-tse Huang , Pinjia He

Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model with proprietary and private data, where data privacy is a pivotal concern. Whereas extensive research has demonstrated the privacy risks of large…

Cryptography and Security · Computer Science 2024-03-03 Shenglai Zeng , Jiankun Zhang , Pengfei He , Yue Xing , Yiding Liu , Han Xu , Jie Ren , Shuaiqiang Wang , Dawei Yin , Yi Chang , Jiliang Tang

Recent improvement gains in large language models (LLMs) have lead to everyday usage of AI-based Conversational Agents (CAs). At the same time, LLMs are vulnerable to an array of threats, including jailbreaks and, for example, causing…

Cryptography and Security · Computer Science 2025-11-03 Kathrin Grosse , Nico Ebert

The increasing integration of artificial intelligence (AI) in digital ecosystems has reshaped privacy dynamics, particularly for young digital citizens navigating data-driven environments. This study explores evolving privacy concerns…

Computers and Society · Computer Science 2025-12-16 Ankur Barthwal , Molly Campbell , Ajay Kumar Shrestha

As the adoption of explainable AI (XAI) continues to expand, the urgency to address its privacy implications intensifies. Despite a growing corpus of research in AI privacy and explainability, there is little attention on privacy-preserving…

Cryptography and Security · Computer Science 2024-06-27 Thanh Tam Nguyen , Thanh Trung Huynh , Zhao Ren , Thanh Toan Nguyen , Phi Le Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

AI chatbots designed as emotional companions blur the boundaries between interpersonal intimacy and institutional software, creating a complex, multi-dimensional privacy environment. Drawing on Communication Privacy Management theory and…

Cryptography and Security · Computer Science 2026-01-19 Hsuen-Chi Chiu , Jeremy Foote