中文
相关论文

相关论文: Two-in-One: A Model Hijacking Attack Against Text …

200 篇论文

Large Vision-Language Models (LVLMs) are susceptible to typographic attacks, which are misclassifications caused by an attack text that is added to an image. In this paper, we introduce a multi-image setting for studying typographic…

密码学与安全 · 计算机科学 2025-02-13 Xiaomeng Wang , Zhengyu Zhao , Martha Larson

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

机器学习 · 计算机科学 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

The recent large-scale emergence of LLMs has left an open space for dealing with their consequences, such as plagiarism or the spread of false information on the Internet. Coupling this with the rise of AI detector bypassing tools, reliable…

机器学习 · 计算机科学 2026-05-15 Andrii Shportko , Inessa Verbitsky

Natural language processing models based on neural networks are vulnerable to adversarial examples. These adversarial examples are imperceptible to human readers but can mislead models to make the wrong predictions. In a black-box setting,…

计算与语言 · 计算机科学 2023-03-14 Hai Zhu , Qingyang Zhao , Yuren Wu

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

密码学与安全 · 计算机科学 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

密码学与安全 · 计算机科学 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Backdoor attacks manipulate model predictions by inserting innocuous triggers into training and test data. We focus on more realistic and more challenging clean-label attacks where the adversarial training examples are correctly labeled.…

机器学习 · 计算机科学 2023-10-31 Wencong You , Zayd Hammoudeh , Daniel Lowd

Building advanced machine learning (ML) models requires expert knowledge and many trials to discover the best architecture and hyperparameter settings. Previous work demonstrates that model information can be leveraged to assist other…

密码学与安全 · 计算机科学 2023-02-24 Boyang Zhang , Xinlei He , Yun Shen , Tianhao Wang , Yang Zhang

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

密码学与安全 · 计算机科学 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

In recent years, there has been an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have…

密码学与安全 · 计算机科学 2024-06-11 Wenshu Fan , Hongwei Li , Wenbo Jiang , Meng Hao , Shui Yu , Xiao Zhang

Fake reviews and review manipulation are growing problems on online marketplaces globally. Review Hijacking is a new review manipulation tactic in which unethical sellers "hijack" an existing product page (usually one with many positive…

计算与语言 · 计算机科学 2021-09-27 Monika Daryani , James Caverlee

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

计算与语言 · 计算机科学 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

Pre-trained language models allowed us to process downstream tasks with the help of fine-tuning, which aids the model to achieve fairly high accuracy in various Natural Language Processing (NLP) tasks. Such easily-downloaded language models…

计算与语言 · 计算机科学 2022-11-22 Jaechul Roh , Minhao Cheng , Yajun Fang

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

机器学习 · 计算机科学 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Modern image-to-text systems typically adopt the encoder-decoder framework, which comprises two main components: an image encoder, responsible for extracting image features, and a transformer-based decoder, used for generating captions.…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Raz Lapid , Moshe Sipper

Machine learning models are known to be vulnerable to adversarial attacks, but traditional attacks have mostly focused on single-modalities. With the rise of large multi-modal models (LMMs) like CLIP, which combine vision and language…

机器学习 · 计算机科学 2024-10-18 Arka Daw , Megan Hong-Thanh Chung , Maria Mahbub , Amir Sadovnik

Model selection is a fundamental task in Machine Learning~(ML), focusing on selecting the most suitable model from a pool of candidates by evaluating their performance on specific metrics. This process ensures optimal performance,…

机器学习 · 计算机科学 2025-02-21 Riccardo Petrucci , Luca Pajola , Francesco Marchiori , Luca Pasa , Mauro conti

Text-to-Image(T2I) models have achieved remarkable success in image generation and editing, yet these models still have many potential issues, particularly in generating inappropriate or Not-Safe-For-Work(NSFW) content. Strengthening…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Sensen Gao , Xiaojun Jia , Yihao Huang , Ranjie Duan , Jindong Gu , Yang Bai , Yang Liu , Qing Guo

Hate speech, offensive language, aggression, racism, sexism, and other abusive language are common phenomena in social media. There is a need for Artificial Intelligence(AI)based intervention which can filter hate content at scale. Most…

计算与语言 · 计算机科学 2024-11-13 Prashant Kapil , Asif Ekbal

Neural text ranking models have witnessed significant advancement and are increasingly being deployed in practice. Unfortunately, they also inherit adversarial vulnerabilities of general neural models, which have been detected but remain…

信息检索 · 计算机科学 2023-04-19 Jiawei Liu , Yangyang Kang , Di Tang , Kaisong Song , Changlong Sun , Xiaofeng Wang , Wei Lu , Xiaozhong Liu