中文
相关论文

相关论文: Data Poisoning Attacks and Defenses to Crowdsourci…

200 篇论文

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

密码学与安全 · 计算机科学 2023-06-30 Nils Lukas , Florian Kerschbaum

This demo paper examines the susceptibility of Federated Learning (FL) systems to targeted data poisoning attacks, presenting a novel system for visualizing and mitigating such threats. We simulate targeted data poisoning attacks via label…

密码学与安全 · 计算机科学 2024-05-28 Xueqing Zhang , Junkai Zhang , Ka-Ho Chow , Juntao Chen , Ying Mao , Mohamed Rahouti , Xiang Li , Yuchen Liu , Wenqi Wei

Recent work in open-domain question answering (ODQA) has shown that adversarial poisoning of the search collection can cause large drops in accuracy for production systems. However, little to no work has proposed methods to defend against…

计算与语言 · 计算机科学 2024-02-28 Orion Weller , Aleem Khan , Nathaniel Weir , Dawn Lawrie , Benjamin Van Durme

Healthcare AI systems face major vulnerabilities to data poisoning that current defenses and regulations cannot adequately address. We analyzed eight attack scenarios in four categories: architectural attacks on convolutional neural…

密码学与安全 · 计算机科学 2026-01-26 Farhad Abtahi , Fernando Seoane , Iván Pau , Mario Vega-Barbas

Popular crowdsourcing techniques mostly focus on evaluating workers' labeling quality before adjusting their weights during label aggregation. Recently, another cohort of models regard crowdsourced annotations as incomplete tensors and…

人机交互 · 计算机科学 2019-05-21 Ching-Yun Ko , Rui Lin , Shu Li , Ngai Wong

Security issues related to the cloud computing are relevant to various stakeholders for an informed cloud adoption decision. Apart from data breaches, the cyber security research community is revisiting the attack space for cloud-specific…

密码学与安全 · 计算机科学 2017-08-29 Gaurav Somani , Manoj Singh Gaur , Dheeraj Sanghi , Mauro Conti , Rajkumar Buyya

Deep learning models have achieved high performance on many tasks, and thus have been applied to many security-critical scenarios. For example, deep learning-based face recognition systems have been used to authenticate users to access many…

密码学与安全 · 计算机科学 2017-12-18 Xinyun Chen , Chang Liu , Bo Li , Kimberly Lu , Dawn Song

Many machine learning systems rely on data collected in the wild from untrusted sources, exposing the learning algorithms to data poisoning. Attackers can inject malicious data in the training dataset to subvert the learning process,…

机器学习 · 统计学 2018-10-04 Andrea Paudice , Luis Muñoz-González , Emil C. Lupu

Federated learning is a popular strategy for training models on distributed, sensitive data, while preserving data privacy. Prior work identified a range of security threats on federated learning protocols that poison the data or the model.…

密码学与安全 · 计算机科学 2022-08-30 Giorgio Severi , Matthew Jagielski , Gökberk Yar , Yuxuan Wang , Alina Oprea , Cristina Nita-Rotaru

In data poisoning attacks, an adversary tries to change a model's prediction by adding, modifying, or removing samples in the training data. Recently, ensemble-based approaches for obtaining provable defenses against data poisoning have…

机器学习 · 计算机科学 2023-05-17 Keivan Rezaei , Kiarash Banihashem , Atoosa Chegini , Soheil Feizi

Mobile crowdsourcing services (MCS), enable fast and economical data acquisition at scale and find applications in a variety of domains. Prior work has shown that Foursquare and Waze (a location-based and a navigation MCS) are vulnerable to…

密码学与安全 · 计算机科学 2021-10-20 Sojhal Ismail Khan , Dominika Woszczyk , Chengzeng You , Soteris Demetriou , Muhammad Naveed

Data poisoning is an attack on machine learning models wherein the attacker adds examples to the training set to manipulate the behavior of the model at test time. This paper explores poisoning attacks on neural nets. The proposed attacks…

The importance of big data is a contested topic among social scientists. Proponents claim it will fuel a research revolution, but skeptics challenge it as unreliably measured and decontextualized, with limited utility for accurately…

计算机与社会 · 计算机科学 2020-06-12 Nathaniel D. Porter , Ashton M. Verdery , S. Michael Gaddis

Crowdsourcing provides an efficient label collection schema for supervised machine learning. However, to control annotation cost, each instance in the crowdsourced data is typically annotated by a small number of annotators. This creates a…

机器学习 · 计算机科学 2021-07-23 Zhendong Chu , Hongning Wang

Data fragmentation and dispersal over multiple clouds is a way of data protection against honest-but-curious storage or service providers. In this paper, we introduce a novel algorithm for data fragmentation that is particularly well…

密码学与安全 · 计算机科学 2018-04-06 Katarzyna Kapusta , Gerard Memmi

Data poisoning -- the process by which an attacker takes control of a model by making imperceptible changes to a subset of the training data -- is an emerging threat in the context of neural networks. Existing attacks for data poisoning…

机器学习 · 计算机科学 2021-02-23 W. Ronny Huang , Jonas Geiping , Liam Fowl , Gavin Taylor , Tom Goldstein

Preference learning is a central component for aligning current LLMs, but this process can be vulnerable to data poisoning attacks. To address this concern, we introduce PoisonBench, a benchmark for evaluating large language models'…

密码学与安全 · 计算机科学 2025-06-09 Tingchen Fu , Mrinank Sharma , Philip Torr , Shay B. Cohen , David Krueger , Fazl Barez

Crowdsourcing refers to the arrangement in which contributions are solicited from a large group of unrelated people. Due to this nature, crowdsourcers (or task requesters) often face uncertainty about the workers' capabilities which, in…

多智能体系统 · 计算机科学 2016-01-25 Han Yu

Crowdsourcing has emerged as a popular approach for collecting annotated data to train supervised machine learning models. However, annotator bias can lead to defective annotations. Though there are a few works investigating individual…

人机交互 · 计算机科学 2021-10-18 Haochen Liu , Joseph Thekinen , Sinem Mollaoglu , Da Tang , Ji Yang , Youlong Cheng , Hui Liu , Jiliang Tang

Crowdsourcing is a favorable computing paradigm for processing computer-hard tasks by harnessing human intelligence. However, generic crowdsourcing systems may lead to privacy-leakage through the sharing of worker data. To tackle this…

计算机科学与博弈论 · 计算机科学 2023-02-23 Xiangping Kang , Guoxian Yu , Jun Wang , Wei Guo , Carlotta Domeniconi , Jinglin Zhang