English
Related papers

Related papers: Examining the Threat Landscape: Foundation Models …

200 papers

Deep Neural Networks (DNNs) are susceptible to model stealing attacks, which allows a data-limited adversary with no knowledge of the training dataset to clone the functionality of a target model, just by using black-box query access. Such…

Machine Learning · Statistics 2019-11-19 Sanjay Kariyappa , Moinuddin K Qureshi

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Machine learning (ML) is becoming a commodity. Numerous ML frameworks and services are available to data holders who are not ML experts but want to train predictive models on their data. It is important that ML models trained on sensitive…

Cryptography and Security · Computer Science 2017-09-28 Congzheng Song , Thomas Ristenpart , Vitaly Shmatikov

Due to the high cost of training, large model (LM) practitioners commonly use pretrained models downloaded from untrusted sources, which could lead to owning compromised models. In-context learning is the ability of LMs to perform multiple…

Cryptography and Security · Computer Science 2024-09-09 Gorka Abad , Stjepan Picek , Lorenzo Cavallaro , Aitor Urbieta

Vision foundation models are widely used as frozen backbones across many downstream tasks, making them a single point of failure under adversarial attack. We study multi-level Floyd-Steinberg error-diffusion dithering as a lightweight,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

Vision foundation models (VFMs) are predominantly developed using data-centric methods. These methods require training on vast amounts of data usually with high-quality labels, which poses a bottleneck for most institutions that lack both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jiabo Huang , Chen Chen , Lingjuan Lyu

Model extraction increasingly attracts research attentions as keeping commercial AI models private can retain a competitive advantage. In some scenarios, AI models are trained proprietarily, where neither pre-trained models nor sufficient…

Machine Learning · Computer Science 2021-04-14 Xinyi Zhang , Chengfang Fang , Jie Shi

Foundation models such as CLIP have demonstrated exceptional zero- and few-shot transfer capabilities across diverse vision tasks. However, when fine-tuned for highly specialized biometric tasks, face recognition (FR), morphing attack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Tahar Chettaoui , Naser Damer , Fadi Boutros

Foundation models are vital tools in various Computer Vision applications. They take as input a single RGB image and output a deep feature representation that is useful for various applications. However, in case we have multiple views of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Leo Segre , Or Hirschorn , Shai Avidan

Model stitching, connecting early layers of one model (source) to later layers of another (target) via a light stitch layer, has served as a probe of representational compatibility. Prior work finds that models trained on the same dataset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zheda Mai , Ke Zhang , Fu-En Wang , Zixiao Ken Wang , Albert Y. C. Chen , Lu Xia , Min Sun , Wei-Lun Chao , Cheng-Hao Kuo

Federated Learning (FL) is a collaborative learning framework designed to protect client data, yet it remains highly vulnerable to Intellectual Property (IP) threats. Model extraction (ME) attacks pose a significant risk to Machine Learning…

Cryptography and Security · Computer Science 2025-06-02 Sayyed Farid Ahamed , Sandip Roy , Soumya Banerjee , Marc Vucovich , Kevin Choi , Abdul Rahman , Alison Hu , Edward Bowen , Sachin Shetty

To launch black-box attacks against a Deep Neural Network (DNN) based Face Recognition (FR) system, one needs to build \textit{substitute} models to simulate the target model, so the adversarial examples discovered from substitute models…

Machine Learning · Computer Science 2018-08-23 Di Tang , XiaoFeng Wang , Kehuan Zhang

Despite the considerable performance improvements of face recognition algorithms in recent years, the same scientific advances responsible for this progress can also be used to create efficient ways to attack them, posing a threat to their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Eduarda Caldeira , Guray Ozgur , Tahar Chettaoui , Marija Ivanovska , Peter Peer , Fadi Boutros , Vitomir Struc , Naser Damer

Federated learning is a learning method for training models over multiple participants without directly sharing their raw data, and it has been expected to be a privacy protection method for training data. In contrast, attack methods have…

Cryptography and Security · Computer Science 2023-08-02 Rei Aso , Sayaka Shiota , Hitoshi Kiya

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. These models are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series…

Risk Management · Quantitative Finance 2025-05-19 Anubha Goel , Puneet Pasricha , Martin Magris , Juho Kanniainen

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

Machine Learning · Computer Science 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

The rapid evolution of generative models has enabled the creation of hyper-realistic facial deepfakes, exposing a critical vulnerability in modern digital forensics: the inability of detectors to generalize to unseen manipulation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ibrahim Delibasoglu

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Face anti-spoofing aims to discriminate the spoofing face images (e.g., printed photos) from live ones. However, adversarial examples greatly challenge its credibility, where adding some perturbation noise can easily change the predictions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Songlin Yang , Wei Wang , Chenye Xu , Ziwen He , Bo Peng , Jing Dong

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai