English
Related papers

Related papers: AIJack: Let's Hijack AI! Security and Privacy Risk…

200 papers

This paper systematically investigates the security, privacy, and ethical risks, as well as the traceability challenges of OpenClaw, a locally executable AI agent system for natural language interaction and real-world task completion. While…

Cryptography and Security · Computer Science 2026-05-25 Yutong Jin , Zelin Zhang , Zhijin Lyu , Jianbing Ni

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…

While advanced machine learning (ML) models are deployed in numerous real-world applications, previous works demonstrate these models have security and privacy vulnerabilities. Various empirical research has been done in this field.…

Cryptography and Security · Computer Science 2023-10-23 Boyang Zhang , Zheng Li , Ziqing Yang , Xinlei He , Michael Backes , Mario Fritz , Yang Zhang

The use of machine learning (ML) has become increasingly prevalent in various domains, highlighting the importance of understanding and ensuring its safety. One pressing concern is the vulnerability of ML applications to model stealing…

Machine Learning · Computer Science 2026-04-07 Ganghua Wang , Yuhong Yang , Jie Ding

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

The integration of artificial intelligence, especially large language models in robotics, has led to rapid advancements in the field. We are now observing an unprecedented surge in the use of robots in our daily lives. The development and…

Robotics · Computer Science 2024-09-17 Diba Afroze , Yazhou Tu , Xiali Hei

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

Machine Learning · Computer Science 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

The proliferation of AI has sparked privacy concerns related to training data, model interfaces, downstream applications, and more. We interviewed 25 AI developers based in Europe to understand which privacy threats they believe pose the…

Human-Computer Interaction · Computer Science 2025-10-02 Alexandra Klymenko , Stephen Meisenbacher , Patrick Gage Kelley , Sai Teja Peddinti , Kurt Thomas , Florian Matthes

The discourse on privacy risks in Large Language Models (LLMs) has disproportionately focused on verbatim memorization of training data, while a constellation of more immediate and scalable privacy threats remain underexplored. This…

Cryptography and Security · Computer Science 2025-10-03 Niloofar Mireshghallah , Tianshi Li

Algorithmic fairness and privacy are essential pillars of trustworthy machine learning. Fair machine learning aims at minimizing discrimination against protected groups by, for example, imposing a constraint on models to equalize their…

Machine Learning · Statistics 2021-04-08 Hongyan Chang , Reza Shokri

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

Computation and Language · Computer Science 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

In recent years, machine learning techniques are widely used in numerous applications, such as weather forecast, financial data analysis, spam filtering, and medical prediction. In the meantime, massive data generated from multiple sources…

Cryptography and Security · Computer Science 2018-10-08 Wei Du , Ang Li , Qinghua Li

With the turmoil in cybersecurity and the mind-blowing advances in AI, it is only natural that cybersecurity practitioners consider further employing learning techniques to help secure their organizations and improve the efficiency of their…

Cryptography and Security · Computer Science 2019-12-17 Ricardo Morla

This paper surveys the landscape of security and data attacks on machine unlearning, with a focus on financial and e-commerce applications. We discuss key privacy threats such as Membership Inference Attacks and Data Reconstruction Attacks,…

Cryptography and Security · Computer Science 2024-10-02 Carl E. J. Brodzinski

Technology is shaping our lives in a multitude of ways. This is fuelled by a technology infrastructure, both legacy and state of the art, composed of a heterogeneous group of hardware, software, services and organisations. Such…

Cryptography and Security · Computer Science 2023-01-18 Julia A. Meister , Raja Naeem Akram , Konstantinos Markantonakis

Robotics, automation, and related Artificial Intelligence (AI) systems have become pervasive bringing in concerns related to security, safety, accuracy, and trust. With growing dependency on physical robots that work in close proximity to…

Cryptography and Security · Computer Science 2023-02-17 Sudip Mittal , Jingdao Chen

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

Federated Learning (FL) is an emerging distributed machine learning paradigm enabling multiple clients to train a global model collaboratively without sharing their raw data. While FL enhances data privacy by design, it remains vulnerable…

As AI agents increasingly operate in complex environments, ensuring reliable, context-aware privacy is critical for regulatory compliance. Traditional access controls are insufficient because privacy risks often arise after access is…

Federated learning is a machine learning technique that enables training across decentralized data. Recently, federated learning has become an active area of research due to an increased focus on privacy and security. In light of this, a…

Machine Learning · Computer Science 2021-11-09 Jae Hun Ro , Ananda Theertha Suresh , Ke Wu