English
Related papers

Related papers: PORE: Provably Robust Recommender Systems against …

200 papers

Considering the premise that the number of products offered grow in an exponential fashion and the amount of data that a user can assimilate before making a decision is relatively small, recommender systems help in categorizing content…

Information Retrieval · Computer Science 2024-04-26 Aditya Chichani , Juzer Golwala , Tejas Gundecha , Kiran Gawande

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

Machine Learning · Computer Science 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

Machine Learning · Computer Science 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

Machine Learning · Computer Science 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

Data poisoning and backdoor attacks manipulate training data in order to cause models to fail during inference. A recent survey of industry practitioners found that data poisoning is the number one concern among threats ranging from model…

Machine Learning · Computer Science 2021-06-18 Avi Schwarzschild , Micah Goldblum , Arjun Gupta , John P Dickerson , Tom Goldstein

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

Cryptography and Security · Computer Science 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

Recommender systems have been shown to be vulnerable to poisoning attacks, where malicious data is injected into the dataset to cause the recommender system to provide biased recommendations. To defend against such attacks, various robust…

Machine Learning · Computer Science 2023-10-02 Yichang Xu , Chenwang Wu , Defu Lian

Adversarial training instances can severely distort a model's behavior. This work investigates certified regression defenses, which provide guaranteed limits on how much a regressor's prediction may change under a poisoning attack. Our key…

Machine Learning · Computer Science 2023-01-02 Zayd Hammoudeh , Daniel Lowd

Explainable Recommendation has been gaining attention over the last few years in industry and academia. Explanations provided along with recommendations in a recommender system framework have many uses: particularly reasoning why a…

Information Retrieval · Computer Science 2024-05-06 Sairamvinay Vijayaraghavan , Prasant Mohapatra

A powerful category of (invisible) data poisoning attacks modify a subset of training examples by small adversarial perturbations to change the prediction of certain test-time data. Existing defense mechanisms are not desirable to deploy in…

Cryptography and Security · Computer Science 2023-07-21 Tian Yu Liu , Yu Yang , Baharan Mirzasoleiman

Conformal prediction (CP) can convert any model's output into prediction sets guaranteed to include the true label with any user-specified probability. However, same as the model itself, CP is vulnerable to adversarial test examples…

Machine Learning · Computer Science 2024-07-15 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Making learners robust to adversarial perturbation at test time (i.e., evasion attacks) or training time (i.e., poisoning attacks) has emerged as a challenging task. It is known that for some natural settings, sublinear perturbations in the…

Machine Learning · Computer Science 2018-11-07 Saeed Mahloujifar , Mohammad Mahmoody

Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by injecting a fraction of…

Cryptography and Security · Computer Science 2021-05-11 Jian Chen , Xuxin Zhang , Rui Zhang , Chen Wang , Ling Liu

Recent studies have proven that deep neural networks are vulnerable to backdoor attacks. Specifically, by mixing a small number of poisoned samples into the training set, the behavior of the trained model can be maliciously controlled.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Pengfei Xia , Ziqiang Li , Wei Zhang , Bin Li

Data poisoning attacks and backdoor attacks aim to corrupt a machine learning classifier via modifying, adding, and/or removing some carefully selected training examples, such that the corrupted classifier makes incorrect predictions as the…

Cryptography and Security · Computer Science 2021-12-03 Jinyuan Jia , Yupei Liu , Xiaoyu Cao , Neil Zhenqiang Gong

Recommender systems are essential for personalizing digital experiences on e-commerce sites, streaming services, and social media platforms. While these systems are necessary for modern digital interactions, they face fairness, bias,…

Information Retrieval · Computer Science 2024-09-20 Falguni Roy , Xiaofeng Ding , K. -K. R. Choo , Pan Zhou

A key challenge of big data analytics is how to collect a large volume of (labeled) data. Crowdsourcing aims to address this challenge via aggregating and estimating high-quality data (e.g., sentiment label for text) from pervasive…

Cryptography and Security · Computer Science 2021-02-26 Minghong Fang , Minghao Sun , Qi Li , Neil Zhenqiang Gong , Jin Tian , Jia Liu

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed to defend against…

Cryptography and Security · Computer Science 2020-07-21 Binghui Wang , Xiaoyu Cao , Jinyuan jia , Neil Zhenqiang Gong

Data poisoning considers cases when an adversary manipulates the behavior of machine learning algorithms through malicious training data. Existing threat models of data poisoning center around a single metric, the number of poisoned…

Machine Learning · Computer Science 2023-12-08 Wenxiao Wang , Soheil Feizi