中文
相关论文

相关论文: Is your benchmark truly adversarial? AdvScore: Eva…

200 篇论文

As designers of artificial intelligence try to outwit hackers, both sides continue to hone in on AI's inherent vulnerabilities. Designed and trained from certain statistical distributions of data, AI's deep neural networks (DNNs) remain…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Wenzhao Xiang , Hang Su , Chang Liu , Yandong Guo , Shibao Zheng

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

机器学习 · 计算机科学 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

机器学习 · 计算机科学 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

There are a number of hypotheses underlying the existence of adversarial examples for classification problems. These include the high-dimensionality of the data, high codimension in the ambient space of the data manifolds of interest, and…

Cognitive sensing refers to a reconfigurable sensor that dynamically adapts its sensing mechanism by using stochastic control to optimize its sensing resources. For example, cognitive radars are sophisticated dynamical systems; they use…

信号处理 · 电气工程与系统科学 2020-02-26 Vikram Krishnamurthy

Adversarial reprogramming allows repurposing a machine-learning model to perform a different task. For example, a model trained to recognize animals can be reprogrammed to recognize digits by embedding an adversarial program in the digit…

机器学习 · 计算机科学 2023-03-14 Yang Zheng , Xiaoyi Feng , Zhaoqiang Xia , Xiaoyue Jiang , Ambra Demontis , Maura Pintor , Battista Biggio , Fabio Roli

More than one hundred benchmarks have been developed to test the commonsense knowledge and commonsense reasoning abilities of artificial intelligence (AI) systems. However, these benchmarks are often flawed and many aspects of common sense…

人工智能 · 计算机科学 2023-02-24 Ernest Davis

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

机器学习 · 计算机科学 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

音频与语音处理 · 电气工程与系统科学 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

Adversarial attacks insert small, imperceptible perturbations to input samples that cause large, undesired changes to the output of deep learning models. Despite extensive research on generating adversarial attacks and building defense…

机器学习 · 计算机科学 2023-06-27 Vyas Raina , Mark Gales

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

机器学习 · 计算机科学 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

机器学习 · 计算机科学 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

During the past decade, model-based recommendation methods have evolved from latent factor models to neural network-based models. Most of these techniques mainly focus on improving the overall performance, such as the root mean square error…

信息检索 · 计算机科学 2018-08-17 Feng Yuan , Lina Yao , Boualem Benatallah

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

The rapid advancement of generative image technology has introduced significant security concerns, particularly in the domain of face generation detection. This paper investigates the vulnerabilities of current AI-generated face detection…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Sun Haoxuan , Hong Yan , Zhan Jiahui , Chen Haoxing , Lan Jun , Zhu Huijia , Wang Weiqiang , Zhang Liqing , Zhang Jianfu

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

机器学习 · 计算机科学 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

With the steady rise of the use of AI in bio-technical applications and the widespread adoption of genomics sequencing, an increasing amount of AI-based algorithms and tools is entering the research and production stage affecting critical…

机器学习 · 计算机科学 2024-01-22 Heorhii Skovorodnikov , Hoda Alkhzaimi

As AI agents surpass human capabilities, scalable oversight -- the problem of effectively supplying human feedback to potentially superhuman AI models -- becomes increasingly critical to ensure alignment. While numerous scalable oversight…

人工智能 · 计算机科学 2025-04-08 Abhimanyu Pallavi Sudhir , Jackson Kaunismaa , Arjun Panickssery