English
Related papers

Related papers: TA3: Testing Against Adversarial Attacks on Machin…

200 papers

Adversarial examples derived from deliberately crafted perturbations on visual inputs can easily harm decision process of deep neural networks. To prevent potential threats, various adversarial training-based defense methods have grown…

Machine Learning · Computer Science 2023-07-19 Byung-Kwan Lee , Junho Kim , Yong Man Ro

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

Artificial Intelligence · Computer Science 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Adversaries continuously evolve their tactics, techniques, and procedures (TTPs) to achieve their objectives while evading detection, requiring defenders to continually update their understanding of adversary behavior. Prior research has…

Software Engineering · Computer Science 2026-04-06 Mahzabin Tamanna , Shaswata Mitra , Md Erfan , Ahmed Ryan , Sudip Mittal , Laurie Williams , Md Rayhanur Rahman

Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few…

Machine Learning · Computer Science 2018-10-02 Anirban Chakraborty , Manaar Alam , Vishal Dey , Anupam Chattopadhyay , Debdeep Mukhopadhyay

As machine learning models grow in complexity and increasingly rely on publicly sourced data, such as the human-annotated labels used in training large language models, they become more vulnerable to label poisoning attacks. These attacks,…

Machine Learning · Computer Science 2025-02-25 Melis Ilayda Bal , Volkan Cevher , Michael Muehlebach

Deep Reinforcement Learning (DRL) has numerous applications in the real world thanks to its outstanding ability in quickly adapting to the surrounding environments. Despite its great advantages, DRL is susceptible to adversarial attacks,…

Machine Learning · Computer Science 2021-09-09 Inaam Ilahi , Muhammad Usama , Junaid Qadir , Muhammad Umar Janjua , Ala Al-Fuqaha , Dinh Thai Hoang , Dusit Niyato

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

The recent strides in artificial intelligence (AI) and machine learning (ML) have propelled the rise of TinyML, a paradigm enabling AI computations at the edge without dependence on cloud connections. While TinyML offers real-time data…

Cryptography and Security · Computer Science 2024-07-19 Parin Shah , Yuvaraj Govindarajulu , Pavan Kulkarni , Manojkumar Parmar

Deep Metric Learning (DML) has shown remarkable successes in many domains by taking advantage of powerful deep neural networks. Deep neural networks are prone to adversarial attacks and could be easily fooled by adversarial examples. The…

Machine Learning · Computer Science 2025-01-14 Xiaopeng Ke

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Trajectory prediction is an integral component of modern autonomous systems as it allows for envisioning future intentions of nearby moving agents. Due to the lack of other agents' dynamics and control policies, deep neural network (DNN)…

Machine Learning · Computer Science 2022-12-09 Kaiyuan Tan , Jun Wang , Yiannis Kantaros

Adversarial attacks are a potential threat to machine learning models by causing incorrect predictions through imperceptible perturbations to the input data. While these attacks have been extensively studied in unstructured data like…

Machine Learning · Computer Science 2024-12-13 Zhipeng He , Chun Ouyang , Laith Alzubaidi , Alistair Barros , Catarina Moreira

Deep learning models (with neural networks) have been widely used in challenging tasks such as computer-aided disease diagnosis based on medical images. Recent studies have shown deep diagnostic models may not be robust in the inference…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Mengting Xu , Tao Zhang , Zhongnian Li , Mingxia Liu , Daoqiang Zhang

Machine learning is a popular approach to signatureless malware detection because it can generalize to never-before-seen malware families and polymorphic strains. This has resulted in its practical use for either primary detection engines…

Cryptography and Security · Computer Science 2018-01-31 Hyrum S. Anderson , Anant Kharkar , Bobby Filar , David Evans , Phil Roth

Machine learning (ML) underpins foundation models in finance, healthcare, and critical infrastructure, making them targets for data poisoning, model extraction, prompt injection, automated jailbreaking, and preference-guided black-box…

Cryptography and Security · Computer Science 2025-12-30 Armstrong Foundjem , Lionel Nganyewou Tidjon , Leuson Da Silva , Foutse Khomh

The introduction of multimodal models is a huge step forward in Artificial Intelligence. A single model is trained to understand multiple modalities: text, image, video, and audio. Open-source multimodal models have made these breakthroughs…

Machine Learning · Computer Science 2025-09-03 Shashank Kapoor , Sanjay Surendranath Girija , Lakshit Arora , Dipen Pradhan , Ankit Shetgaonkar , Aman Raj

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Recent studies show that Deep Reinforcement Learning (DRL) models are vulnerable to adversarial attacks, which attack DRL models by adding small perturbations to the observations. However, some attacks assume full availability of the victim…

Machine Learning · Computer Science 2022-02-18 Xinlei Pan , Chaowei Xiao , Warren He , Shuang Yang , Jian Peng , Mingjie Sun , Jinfeng Yi , Zijiang Yang , Mingyan Liu , Bo Li , Dawn Song

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Deep learning models achieve remarkable accuracy in computer vision tasks, yet remain vulnerable to adversarial examples--carefully crafted perturbations to input images that can deceive these models into making confident but incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Khoi Nguyen Tiet Nguyen , Wenyu Zhang , Kangkang Lu , Yuhuan Wu , Xingjian Zheng , Hui Li Tan , Liangli Zhen