English
Related papers

Related papers: Detecting adversaries in Crowdsourcing

200 papers

There has been much recent interest in understanding the continuum from adversarial to stochastic settings in online learning, with various frameworks including smoothed settings proposed to bridge this gap. We consider the more general and…

Machine Learning · Statistics 2025-06-19 Moïse Blanchard , Samory Kpotufe

Machine learning classifiers with high test accuracy often perform poorly under adversarial attacks. It is commonly believed that adversarial training alleviates this issue. In this paper, we demonstrate that, surprisingly, the opposite may…

Machine Learning · Computer Science 2022-03-30 Jacob Clarysse , Julia Hörrmann , Fanny Yang

Many deep learning methods have successfully solved complex tasks in computer vision and speech recognition applications. Nonetheless, the robustness of these models has been found to be vulnerable to perturbed inputs or adversarial…

Machine Learning · Computer Science 2022-06-20 Danush Kumar Venkatesh , Peter Steinbach

Consider the following model to study adversarial effects on opinion forming. A set of initially selected experts form their binary opinion while being influenced by an adversary, who may convince some of them of the falsehood. All other…

Artificial Intelligence · Computer Science 2021-12-02 Konstantinos Panagiotou , Simon Reisser

Crowdsourcing has emerged as a popular approach for collecting annotated data to train supervised machine learning models. However, annotator bias can lead to defective annotations. Though there are a few works investigating individual…

Human-Computer Interaction · Computer Science 2021-10-18 Haochen Liu , Joseph Thekinen , Sinem Mollaoglu , Da Tang , Ji Yang , Youlong Cheng , Hui Liu , Jiliang Tang

Crafting adversarial examples has become an important technique to evaluate the robustness of deep neural networks (DNNs). However, most existing works focus on attacking the image classification problem since its input space is continuous…

Machine Learning · Computer Science 2020-04-22 Minhao Cheng , Jinfeng Yi , Pin-Yu Chen , Huan Zhang , Cho-Jui Hsieh

Deep Learning models are vulnerable to adversarial examples, i.e.\ images obtained via deliberate imperceptible perturbations, such that the model misclassifies them with high confidence. However, class confidence by itself is an incomplete…

Machine Learning · Statistics 2017-11-23 Ambrish Rawat , Martin Wistuba , Maria-Irina Nicolae

Adversarial attacks pose a threat to deep learning models. However, research on adversarial detection methods, especially in the multi-modal domain, is very limited. In this work, we propose an efficient and straightforward detection method…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Pingchuan Ma , Stavros Petridis , Maja Pantic

Crowdsourcing is a strategy to categorize data through the contribution of many individuals. A wide range of theoretical and algorithmic contributions are based on the model of Dawid and Skene [1]. Recently it was shown in [2,3] that, in…

Machine Learning · Statistics 2020-04-02 Christian Schmidt , Lenka Zdeborová

We present and analyze results from a pilot study that explores how crowdsourcing can be used in the process of generating distractors (incorrect answer choices) in multiple-choice concept inventories (conceptual tests of understanding). To…

Human-Computer Interaction · Computer Science 2019-09-11 Travis Scheponik , Enis Golaszewski , Geoffrey Herman , Spencer Offenberger , Linda Oliva , Peter A. H. Peterson , Alan T. Sherman

Over recent years, devising classification algorithms that are robust to adversarial perturbations has emerged as a challenging problem. In particular, deep neural nets (DNNs) seem to be susceptible to small imperceptible changes over test…

Machine Learning · Computer Science 2019-12-20 Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody

Deep neural network (DNN) models are wellknown to easily misclassify prediction results by using input images with small perturbations, called adversarial examples. In this paper, we propose a novel adversarial detector, which consists of a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Takayuki Osakabe , Maungmaung Aprilpyone , Sayaka Shiota , Hitoshi Kiya

Over the last few years, convolutional neural networks (CNNs) have proved to reach super-human performance in visual recognition tasks. However, CNNs can easily be fooled by adversarial examples, i.e., maliciously-crafted images that force…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Federico Nesti , Alessandro Biondi , Giorgio Buttazzo

An adversary is essentially an algorithm intent on making a classification system perform in some particular way given an input, e.g., increase the probability of a false negative. Recent work builds adversaries for deep learning systems…

Machine Learning · Computer Science 2015-07-20 Corey Kereliuk , Bob L. Sturm , Jan Larsen

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

Though deep neural network has hit a huge success in recent studies and applica- tions, it still remains vulnerable to adversarial perturbations which are imperceptible to humans. To address this problem, we propose a novel network called…

Machine Learning · Computer Science 2017-12-25 Jiefeng Chen , Zihang Meng , Changtian Sun , Wei Tang , Yinglun Zhu

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

As the number and complexity of malware attacks continue to increase, there is an urgent need for effective malware detection systems. While deep learning models are effective at detecting malware, they are vulnerable to adversarial…

Cryptography and Security · Computer Science 2023-12-18 Mahesh Datta Sai Ponnuru , Likhitha Amasala , Tanu Sree Bhimavarapu , Guna Chaitanya Garikipati

This paper explores and offers guidance on a specific and relevant problem in task design for crowdsourcing: how to formulate a complex question used to classify a set of items. In micro-task markets, classification is still among the most…

Human-Computer Interaction · Computer Science 2020-11-19 Jorge Ramírez , Marcos Baez , Fabio Casati , Luca Cernuzzi , Boualem Benatallah , Ekaterina A. Taran , Veronika A. Malanina

Most machine learning classifiers, including deep neural networks, are vulnerable to adversarial examples. Such inputs are typically generated by adding small but purposeful modifications that lead to incorrect outputs while imperceptible…

Machine Learning · Computer Science 2017-09-28 Beilun Wang , Ji Gao , Yanjun Qi