中文
相关论文

相关论文: Data Poisoning Vulnerabilities Across Healthcare A…

200 篇论文

Data poisoning causes misclassification of test time target examples by injecting maliciously crafted samples in the training data. Existing defenses are often effective only against a specific type of targeted attack, significantly degrade…

机器学习 · 计算机科学 2022-10-19 Yu Yang , Tian Yu Liu , Baharan Mirzasoleiman

Electronic Health Records (EHRs) provide a wealth of information for machine learning algorithms to predict the patient outcome from the data including diagnostic information, vital signals, lab tests, drug administration, and demographic…

机器学习 · 计算机科学 2021-06-16 Byunggill Joe , Akshay Mehra , Insik Shin , Jihun Hamm

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

This article deals with the IT security of connectionist artificial intelligence (AI) applications, focusing on threats to integrity, one of the three IT security goals. Such threats are for instance most relevant in prominent AI computer…

密码学与安全 · 计算机科学 2020-07-30 Christian Berghoff , Matthias Neu , Arndt von Twickel

Data poisoning and backdoor attacks manipulate training data in order to cause models to fail during inference. A recent survey of industry practitioners found that data poisoning is the number one concern among threats ranging from model…

机器学习 · 计算机科学 2021-06-18 Avi Schwarzschild , Micah Goldblum , Arjun Gupta , John P Dickerson , Tom Goldstein

Medical Large Language Models (LLMs) are increasingly deployed for clinical decision support across diverse specialties, yet systematic evaluation of their robustness to adversarial misuse and privacy leakage remains inaccessible to most…

密码学与安全 · 计算机科学 2025-12-10 Jinghao Wang , Ping Zhang , Carter Yagemann

A key challenge of big data analytics is how to collect a large volume of (labeled) data. Crowdsourcing aims to address this challenge via aggregating and estimating high-quality data (e.g., sentiment label for text) from pervasive…

密码学与安全 · 计算机科学 2021-02-26 Minghong Fang , Minghao Sun , Qi Li , Neil Zhenqiang Gong , Jin Tian , Jia Liu

The rapid growth of Artificial Intelligence (AI) models and applications has led to an increasingly complex security landscape. Developers of AI projects must contend not only with traditional software supply chain issues but also with…

软件工程 · 计算机科学 2026-01-12 The Anh Nguyen , Triet Huynh Minh Le , M. Ali Babar

The lifecycle of large language models (LLMs) is far more complex than that of traditional machine learning models, involving multiple training stages, diverse data sources, and varied inference methods. While prior research on data…

密码学与安全 · 计算机科学 2025-02-21 Pengfei He , Yue Xing , Han Xu , Zhen Xiang , Jiliang Tang

Data poisoning attacks compromise the integrity of machine-learning models by introducing malicious training samples to influence the results during test time. In this work, we investigate backdoor data poisoning attack on deep neural…

机器学习 · 计算机科学 2019-12-04 Mahesh Subedar , Nilesh Ahuja , Ranganath Krishnan , Ibrahima J. Ndiour , Omesh Tickoo

Adversarial training (AT) is a robust learning algorithm that can defend against adversarial attacks in the inference phase and mitigate the side effects of corrupted data in the training phase. As such, it has become an indispensable…

密码学与安全 · 计算机科学 2023-05-02 Jingfeng Zhang , Bo Song , Bo Han , Lei Liu , Gang Niu , Masashi Sugiyama

Data Poisoning (DP) is an effective attack that causes trained classifiers to misclassify their inputs. DP attacks significantly degrade a classifier's accuracy by covertly injecting attack samples into the training set. Broadly applicable…

机器学习 · 计算机科学 2022-05-13 Xi Li , David J. Miller , Zhen Xiang , George Kesidis

As vendors adopt AI technologies, security researchers are working to uncover and fix related vulnerabilities, which is important given AI systems handle sensitive data and critical functions. This process relies on vendors receiving and…

密码学与安全 · 计算机科学 2026-01-22 Yangheran Piao , Jingjie Li , Daniel W. Woods

Large language models (LLMs)-powered AI agents exhibit a high level of autonomy in addressing medical and healthcare challenges. With the ability to access various tools, they can operate within an open-ended action space. However, with the…

密码学与安全 · 计算机科学 2025-04-08 Jianing Qiu , Lin Li , Jiankai Sun , Hao Wei , Zhe Xu , Kyle Lam , Wu Yuan

The integration of Large Language Models (LLMs) into healthcare demands a safety paradigm rooted in \textit{primum non nocere}. However, current alignment techniques rely on generic definitions of harm that fail to capture context-dependent…

计算机与社会 · 计算机科学 2025-12-01 Andrew Maranhão Ventura D'addario

Risks associated with the use of AI, ranging from algorithmic bias to model hallucinations, have received much attention and extensive research across the AI community, from researchers to end-users. However, a gap exists in the systematic…

人工智能 · 计算机科学 2025-11-21 Raymond K. Sheh , Karen Geappen

Data poisoning attacks, in which a malicious adversary aims to influence a model by injecting "poisoned" data into the training process, have attracted significant recent attention. In this work, we take a closer look at existing poisoning…

机器学习 · 计算机科学 2024-02-16 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Web-scraped datasets are vulnerable to data poisoning, which can be used for backdooring deep image classifiers during training. Since training on large datasets is expensive, a model is trained once and re-used many times. Unlike…

机器学习 · 计算机科学 2024-01-23 Benjamin Schneider , Nils Lukas , Florian Kerschbaum

Data poisoning has been proposed as a compelling defense against facial recognition models trained on Web-scraped pictures. Users can perturb images they post online, so that models will misclassify future (unperturbed) pictures. We…

机器学习 · 计算机科学 2022-03-15 Evani Radiya-Dixit , Sanghyun Hong , Nicholas Carlini , Florian Tramèr

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

机器学习 · 计算机科学 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani