English
Related papers

Related papers: Certifiable Black-Box Attacks with Randomized Adve…

200 papers

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Wenxuan Wang , Bangjie Yin , Taiping Yao , Li Zhang , Yanwei Fu , Shouhong Ding , Jilin Li , Feiyue Huang , Xiangyang Xue

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

Our paper presents a novel defence against black box attacks, where attackers use the victim model as an oracle to craft their adversarial examples. Unlike traditional preprocessing defences that rely on sanitizing input samples, our…

Cryptography and Security · Computer Science 2024-03-19 Roey Bokobza , Yisroel Mirsky

Deep neural network-based classifiers are prone to errors when processing adversarial examples (AEs). AEs are minimally perturbed input data undetectable to humans posing significant risks to security-dependent applications. Hence,…

Cryptography and Security · Computer Science 2026-01-05 Fumiya Morimoto , Ryuto Morita , Satoshi Ono

Current Visual-Language Pre-training (VLP) models are vulnerable to adversarial examples. These adversarial examples present substantial security risks to VLP models, as they can leverage inherent weaknesses in the models, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bangyan He , Xiaojun Jia , Siyuan Liang , Tianrui Lou , Yang Liu , Xiaochun Cao

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Audio adversarial examples (AEs) have posed significant security challenges to real-world speaker recognition systems. Most black-box attacks still require certain information from the speaker recognition model to be effective (e.g.,…

Sound · Computer Science 2023-11-21 Rui Duan , Zhe Qu , Leah Ding , Yao Liu , Zhuo Lu

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

Machine-learning models for security-critical applications such as bot, malware, or spam detection, operate in constrained discrete domains. These applications would benefit from having provable guarantees against adversarial examples. The…

Machine Learning · Computer Science 2019-07-02 Bogdan Kulynych , Jamie Hayes , Nikita Samarin , Carmela Troncoso

In this paper, we study PAC learnability and certification of predictions under instance-targeted poisoning attacks, where the adversary who knows the test instance may change a fraction of the training set with the goal of fooling the…

Machine Learning · Computer Science 2021-08-10 Ji Gao , Amin Karbasi , Mohammad Mahmoody

The adversarial vulnerability of deep networks has spurred the interest of researchers worldwide. Unsurprisingly, like images, adversarial examples also translate to time-series data as they are an inherent weakness of the model itself…

Machine Learning · Computer Science 2020-09-01 Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

In this work, we highlight and perform a comprehensive study on calibration attacks, a form of adversarial attacks that aim to trap victim models to be heavily miscalibrated without altering their predicted labels, hence endangering the…

Machine Learning · Computer Science 2024-12-03 Stephen Obadinma , Xiaodan Zhu , Hongyu Guo

An intriguing property of deep neural networks is the existence of adversarial examples, which can transfer among different architectures. These transferable adversarial examples may severely hinder deep neural network-based applications.…

Machine Learning · Computer Science 2017-02-08 Yanpei Liu , Xinyun Chen , Chang Liu , Dawn Song

Segment Anything Model (SAM) has attracted significant attention recently, due to its impressive performance on various downstream tasks in a zero-short manner. Computer vision (CV) area might follow the natural language processing (NLP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Chenshuang Zhang , Chaoning Zhang , Taegoo Kang , Donghun Kim , Sung-Ho Bae , In So Kweon

Automatic speaker verification (ASV) is one of the core technologies in biometric identification. With the ubiquitous usage of ASV systems in safety-critical applications, more and more malicious attackers attempt to launch adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

Adversarial examples have posed a severe threat to deep neural networks due to their transferable nature. Currently, various works have paid great efforts to enhance the cross-model transferability, which mostly assume the substitute model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Qilong Zhang , Xiaodan Li , Yuefeng Chen , Jingkuan Song , Lianli Gao , Yuan He , Hui Xue

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learning has been widely…

Machine Learning · Computer Science 2020-08-26 Yinghua Zhang , Yangqiu Song , Jian Liang , Kun Bai , Qiang Yang