English
Related papers

Related papers: TRIGS: Trojan Identification from Gradient-based S…

200 papers

This article uses Deep Learning technologies to safeguard DNA sequencing against Bio-Cyber attacks. We consider a hybrid attack scenario where the payload is encoded into a DNA sequence to activate a Trojan malware implanted in a software…

To ensure AI safety, instruction-tuned Large Language Models (LLMs) are specifically trained to ensure alignment, which refers to making models behave in accordance with human intentions. While these models have demonstrated commendable…

Cryptography and Security · Computer Science 2024-08-19 Haoran Wang , Kai Shu

The globalized semiconductor supply chain has made Hardware Trojans (HT) a significant security threat to embedded systems, necessitating the design of efficient and adaptable detection mechanisms. Despite promising machine learning-based…

Cryptography and Security · Computer Science 2025-10-29 Zhixin Pan , Ziyu Shu , Linh Nguyen , Amberbir Alemayoh

Distributed learning paradigms such as federated learning often involve transmission of model updates, or gradients, over a network, thereby avoiding transmission of private data. However, it is possible for sensitive information about the…

Machine Learning · Computer Science 2021-11-02 Trung Dang , Om Thakkar , Swaroop Ramaswamy , Rajiv Mathews , Peter Chin , Françoise Beaufays

We introduce a method called TracIn that computes the influence of a training example on a prediction made by the model. The idea is to trace how the loss on the test point changes during the training process whenever the training example…

Machine Learning · Computer Science 2020-11-17 Garima Pruthi , Frederick Liu , Mukund Sundararajan , Satyen Kale

Neural networks for image classification tasks assume that any given image during inference belongs to one of the training classes. This closed-set assumption is challenged in real-world applications where models may encounter inputs of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Jinsol Lee , Ghassan AlRegib

Insertion of hardware Trojans (HTs) in integrated circuits is a pernicious threat. Since HTs are activated under rare trigger conditions, detecting them using random logic simulations is infeasible. In this work, we design a reinforcement…

Machine Learning · Computer Science 2022-08-30 Vasudev Gohil , Satwik Patnaik , Hao Guo , Dileep Kalathil , Jeyavijayan , Rajendran

Hateful meme detection aims to prevent the proliferation of hateful memes on various social media platforms. Considering its impact on social environments, this paper introduces a previously ignored but significant threat to hateful meme…

Cryptography and Security · Computer Science 2024-12-23 Ruofei Wang , Hongzhan Lin , Ziyuan Luo , Ka Chun Cheung , Simon See , Jing Ma , Renjie Wan

Face morphing attacks target to circumvent Face Recognition Systems (FRS) by employing face images derived from multiple data subjects (e.g., accomplices and malicious actors). Morphed images can be verified against contributing data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haoyu Zhang , Sushma Venkatesh , Raghavendra Ramachandra , Kiran Raja , Naser Damer , Christoph Busch

Backdoor (Trojan) attack is a common threat to deep neural networks, where samples from one or more source classes embedded with a backdoor trigger will be misclassified to adversarial target classes. Existing methods for detecting whether…

Machine Learning · Computer Science 2023-11-17 Zhen Xiang , Zidi Xiong , Bo Li

Adversarial images pose a severe security threat to multimodal large language models through prompt injection. Existing defenses largely lack a principled understanding of the underlying mechanisms and struggle to balance efficiency and…

Machine Learning · Computer Science 2026-05-26 Dongpeng Zhang , Ke Ma , Yangbangyan Jiang , Gaozheng Pei , Longtao Huang , Qianqian Xu , Qingming Huang

Targeted training-set attacks inject malicious instances into the training set to cause a trained model to mislabel one or more specific test instances. This work proposes the task of target identification, which determines whether a…

Machine Learning · Computer Science 2022-09-07 Zayd Hammoudeh , Daniel Lowd

Model merging has emerged as a powerful technique for combining specialized capabilities from multiple fine-tuned LLMs without additional training costs. However, the security implications of this widely-adopted practice remain critically…

Cryptography and Security · Computer Science 2026-04-02 Jiaqing Li , Zhibo Zhang , Shide Zhou , Yuxi Li , Tianlong Yu , Kailong Wang

The reliance on deep learning algorithms has grown significantly in recent years. Yet, these models are highly vulnerable to adversarial attacks, which introduce visually imperceptible perturbations into testing data to induce…

Machine Learning · Computer Science 2019-06-14 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection…

Machine Learning · Computer Science 2021-09-15 Bin Zhu , Zhaoquan Gu , Le Wang , Zhihong Tian

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

Machine Learning · Computer Science 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

The introduction of robust optimisation has pushed the state-of-the-art in defending against adversarial attacks. Notably, the state-of-the-art projected gradient descent (PGD)-based training method has been shown to be universally and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ezekiel Soremekun , Sakshi Udeshi , Sudipta Chattopadhyay

Federated learning (FL) systems allow decentralized data-owning clients to jointly train a global model through uploading their locally trained updates to a centralized server. The property of decentralization enables adversaries to craft…

Cryptography and Security · Computer Science 2025-04-23 Yanbo Dai , Songze Li , Zihan Gan , Xueluan Gong

Transfer learning provides an effective solution for feasibly and fast customize accurate \textit{Student} models, by transferring the learned knowledge of pre-trained \textit{Teacher} models over large datasets via fine-tuning. Many…

Machine Learning · Computer Science 2020-08-11 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

Transfer learning through the use of pre-trained models has become a growing trend for the machine learning community. Consequently, numerous pre-trained models are released online to facilitate further research. However, it raises…

Machine Learning · Computer Science 2022-07-26 Zhuowen Yuan , Fan Wu , Yunhui Long , Chaowei Xiao , Bo Li