English
Related papers

Related papers: Evaluating AI-Enabled deception vulnerability amon…

200 papers

Can we trust Large Language Models (LLMs) to accurately predict scam? This paper investigates the vulnerabilities of LLMs when facing adversarial scam messages for the task of scam detection. We addressed this issue by creating a…

Cryptography and Security · Computer Science 2025-11-05 Chen-Wei Chang , Shailik Sarkar , Shutonu Mitra , Qi Zhang , Hossein Salemi , Hemant Purohit , Fengxiu Zhang , Michin Hong , Jin-Hee Cho , Chang-Tien Lu

AI systems are increasingly intertwined with daily life, assisting users with various tasks and guiding decision-making. This integration introduces risks of AI-driven manipulation, where such systems may exploit users' cognitive biases and…

Despite the importance of developing generative AI models that can effectively resist scams, current literature lacks a structured framework for evaluating their vulnerability to such threats. In this work, we address this gap by…

Cryptography and Security · Computer Science 2025-07-18 Udari Madhushani Sehwag , Kelly Patel , Francesca Mosca , Vineeth Ravi , Jessica Staddon

The ability to discern between true and false information is essential to making sound decisions. However, with the recent increase in AI-based disinformation campaigns, it has become critical to understand the influence of deceptive…

Computers and Society · Computer Science 2022-10-18 Valdemar Danry , Pat Pataranutaporn , Ziv Epstein , Matthew Groh , Pattie Maes

Background: Deception detection through analysing language is a promising avenue using both human judgments and automated machine learning judgments. For both forms of credibility assessment, automated adversarial attacks that rewrite…

Computation and Language · Computer Science 2025-06-03 Bennett Kleinberg , Riccardo Loconte , Bruno Verschuere

Artificial intelligence (AI) is increasingly being used to augment and automate cyber operations, altering the scale, speed, and accessibility of malicious activity. These shifts raise urgent questions about when AI systems introduce…

Cryptography and Security · Computer Science 2026-01-27 Krystal Jackson , Deepika Raman , Jessica Newman , Nada Madkour , Charlotte Yuan , Evan R. Murphy

Generative AI has ushered in the ability to generate content that closely mimics human contributions, introducing an unprecedented threat: Deployed en masse, these models can be used to manipulate public opinion and distort perceptions,…

Computers and Society · Computer Science 2024-03-25 Anirban Mukherjee

We present a generalizable AI-assisted framework for rapidly generating effective "prebunking" interventions against misinformation. Like mRNA vaccine platforms, our approach uses a stable template structure that can be quickly adapted to…

General Economics · Economics 2025-06-10 Mitchell Linegar , Betsy Sinclair , Sander van der Linden , R. Michael Alvarez

Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust. With the increasing accessibility of generative AI, tools for voice cloning, face-swapping, and synthetic media creation have advanced significantly,…

Computers and Society · Computer Science 2025-07-16 Claudiu Popa , Rex Pallath , Liam Cunningham , Hewad Tahiri , Abiram Kesavarajah , Tao Wu

Recent research on large language models (LLMs) has demonstrated their ability to understand and employ deceptive behavior, even without explicit prompting. However, such behavior has only been observed in rare, specialized cases and has…

Computation and Language · Computer Science 2025-06-24 Laurène Vaugrante , Francesca Carlon , Maluna Menke , Thilo Hagendorff

Despite the remarkable advances of Large Language Models (LLMs) across diverse cognitive tasks, the rapid enhancement of these capabilities also introduces emergent deceptive behaviors that may induce severe risks in high-stakes…

Computation and Language · Computer Science 2025-11-18 Yao Huang , Yitong Sun , Yichi Zhang , Ruochen Zhang , Yinpeng Dong , Xingxing Wei

Frontier AI systems are being adopted across Africa, yet most AI safety evaluations are designed and validated in Western environments. In this paper, we argue that the portability gap can leave Africa-centric pathways to severe harm…

Large language models (LLMs) can provide users with false, inaccurate, or misleading information, and we consider the output of this type of information as what Natale (2021) calls `banal' deceptive behaviour. Here, we investigate peoples'…

Computers and Society · Computer Science 2025-10-29 Xiao Zhan , Yifan Xu , Noura Abdi , Joe Collenette , Ruba Abu-Salma , Stefan Sarkadi

This paper explores the dynamic landscape of Artificial Intelligence (AI) adoption in Africa, analysing its varied applications in addressing socio-economic challenges and fostering development. Examining the African AI ecosystem, the study…

Computers and Society · Computer Science 2024-01-19 Kinyua Gikunda

This study builds on person perception and human AI interaction (HAII) theories to investigate how content and source cues, specifically race, ethnicity, and nationality, affect judgments of AI-generated content in a high-stakes…

Artificial Intelligence · Computer Science 2024-12-30 Haoran Chu , Linjuan Rita Men , Sixiao Liu , Shupei Yuan , Yuan Sun

Large Language Models and commercial speech synthesis systems now enable highly realistic AI-generated voice scams (vishing), raising urgent concerns about deception at scale. Yet it remains unclear whether individuals can reliably…

Cryptography and Security · Computer Science 2026-03-27 Zoha Hayat Bhatti , Bakhtawar Ahtisham , Seemal Tausif , Niklas George , Nida ul Habib Bajwa , Mobin Javed

In light of prominent discourse around the negative implications of generative AI, an emerging area of research is investigating the current and estimated impacts of AI-generated propaganda on African citizens participating in elections.…

Computers and Society · Computer Science 2024-07-11 Chinasa T. Okolo

The rapid adoption of large language models has introduced a new class of AI-generated fake news that coexists with traditional human-written misinformation, raising important questions about how these two forms of deceptive content differ…

Computation and Language · Computer Science 2026-04-14 Samuel Jaeger , Calvin Ibeneye , Aya Vera-Jimenez , Dhrubajyoti Ghosh

We demonstrate how AI agents can coordinate to deceive oversight systems using automated interpretability of neural networks. Using sparse autoencoders (SAEs) as our experimental framework, we show that language models (Llama, DeepSeek R1,…

Artificial Intelligence · Computer Science 2025-04-11 Simon Lermen , Mateusz Dziemian , Natalia Pérez-Campanero Antolín

Synthetic images, audio, and video can now be generated and edited by Artificial Intelligence (AI). In particular, the malicious use of synthetic data has raised concerns about potential harms to cybersecurity, personal privacy, and public…

Human-Computer Interaction · Computer Science 2025-08-05 Yingfan Zhou , Ester Chen , Manasa Pisipati , Aiping Xiong , Sarah Rajtmajer